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FOREWORD 



This compilation of papers represents the presentations made at the 4th National 
Forum on Issues in Vocational Assessment held in St. Louis, March 9-11, 1989. This was 
the biggest forum ever-six general sessions involving 21 presenters and 55 papers sessions 
with 75 presenters. There were approximately 260 people present, representing 
evaluation and assessment from the disciplines of education, rehabilitation and allied 
health professions. 

It's a fact that our field is changing rapidly. When change is happening, it 
naturally brings about issues, concerns, agreements, and conflicts. With that goes a need 
for discussion and candidness. When VEWAA began planning the 4th forum, it made the 
decision early on that the forum should be built around current issues in vocational 
evaluation and vocational assessment. Participants in the 4th forum would likely agree 
that the forum faced many issues straight on! 

The forums are sponsored by the Vocational Evaluation and Work Adjustment 
Association, a professional division of the National Rehabilitation Association. When 
forum pioneers Gary Sigmon and Randy McDaniel started out with the first forum in 
Atlanta, 1984, it was somewhat of a trial balloon to see how it would be received and if 
people wanted to do it again. They did and the second, third, and fourth forums were 
held after that, each one different than the last but always with new ideas, discussion, 
and sharing. The forum is no longer an idea to be tried-its part of VEWAA's program 
of activities. We're already planning a 5th national forum! 

A very special thanks go to the Missouri VEWAA chapter. They, and their 
president, Michele Meyer, did an outstanding job of planning and hosting the event. 



Ronald R. Fry 

Coordinator 

Fourth National Forum 
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OCrfflSRCIAL MARKETERS: DO HELP OR HltCei THE FIEU) 



Stephen W. Thoros 



Abstract 



INTRODUCTION 



Some practitioners feel that marketers/developers 
have de-enphasized the role of professional 
evaluators in the assessment process, and are 
responsible for the dramatic reduction in the 
length of evaluation servlcec. On the other 
hand, some marketers feel that their products 
have substantially added to the credibility 
of the field, and have incireased its vinibility. 
This paper highlights panel and group discussions 
that addressed the issues related to the inpact 
that ccnrnercial evaluation/assessment system 
rmrketers and developers have on the reputation 
and practice of evaluation services. 



Oie of the most unique and distinguishing 
aspects of the vocational evaluation/assessment 
process is its use of work sanpl€>3. Today, there 
is a wide variety of comnnercial evaluation and 
work sarrple systems available for use in an ever 
expanding service rreirket. Their popularity has 
dominated the field and, next to psychometric 
tests, are the most widely used evaluati<^n tools, 
exceeding the utilization of situational assess- 
ments and job site evaluations, 

Itiis extensive use has led to the dramtic 
growth in the development and marketing of many 
different kinds of cormiercial evaluation and 
assessment devices. Some of the newer systems 
incorporate the latest in ccrtputer technologies 
and have significantly reduced overall evaluation 
time. The process of commercialization provided 
rmny evaluators with instruments that were far 
more sophisticated and standardized than what 
they could develop locally. As a result, the 
accuracy and reputation of many assessment 
processes were increased. The unnecessary length 
of seme long-term evaluation processes could 
be controlled and minimized and the assessment 
time better utilized. 

With an eye on new markets, ccrnnGi ,al 
system developers and rarketers aggressively 
vended their products while at the same time 
exposing their new audiences to the concepts 
and processes of vocational evaluation and assess- 
ment. As a result, the growth and recognition 
of evaluation practice has been accelerated. 

However, there have been complaints that 
these and other positive contributions by cormer* 
cial marketers and developers have not come 
without their downside. Soms system marketers 
have claimod that their products can be used 
exc?.u8ively with almost any client /student 
population. As a result, seme purchasers have 
obtained systems that did not effectively meet 
the needs of individuals originally targeted 
for the evaluation service. 

Critics have also charged that the length 
of some evaluation /assessment processes has boon 
inappropriately reduced to coincide with the 
titB requirements of the comercial systems that 
were purchased. Additionally, thorough statisti- 
cal analysis and standardization is lacking in 
a number of systems. Specific problems, weak- 
nesses, and limitations in conmercial systems 
have not always been shared prior to a sale, 
resulting in the purchase of a system that does 
not fully meet the needs of the purchaser. 
Lastly, some TOrketers have convinced system 
purchasers that users need not be skilled or 
knowledgeable about vocational evaluation in 
order to be able to use their system. Tl a has 
often dinonished the value of the qualified evalu- 
ator in the hiring process in favor of cheaper, 
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less qualified applicants. 

This ongoing controversy prorrpted the in- 
clusion of a session at It» Fourth Nfeitioiial 
Ponjn on issues in Vocational Assessiient enti- 
tled, "Coamercial Marketers: Do They Help or 
Hinder the Field?" This opening forum session 
began with an introduction of the problem, and 
was followed by a debate on the issues between 
two comnercial system marketers /developers and 
two vocational evaluation service providers. 
The audience was given tiine for questions and 
comnonts, and then organized into small discus- 
sion groups with the specific goal of developing 
and presenting recomnendations for resolving 
the issues under debate. Special thanks are 
extended to the four outstanding professionals 
who agreed to participate in the debate. They 
are: Cheryl Bowers, President, Career Vocational 
Assessment, Inc., San Jose, California (service 
provider); Thomas L. Brandon, President, Work 
Recovery Systems, Tucson, Arizona 
(marketer/practitioner); Randy Lindsey, Director, 
Vocational Research Institute, JEVS, Philadelphia, 
Pennsylvania ^marketer/practitioner); and, Fran 
Smith, Vocational ;\ssettsment Specialist, Mt. 
Vernon Assessment Centfir, Alexandria, Virginia 
( service provider) . Tlie remainder of this paper 
will review the major issues /problens identifie'^ 
during the debate ard the. recomnnendations from 
the audience regarding their resolution. 

SERVICE PRCVIEER POSITION 

Following are highlights of the concerns 
presented by Bowers and Smith at the beginning 
of the debate. 

1. Through their advertisements, ccmmrcial 
marketers seem to offer the promise of meeting 
PedeiBl mandates (e.g., the Carl Perkins Act) 
while promoting the increase in quick scr^jening 
devices. Meeting the intent of regulations^ 
and mandates does not always fully address what 
is beneficial to the person needing the service. 

2. There are no qualifications for the purchase 
and use of work sanples. While in search of 
new evaluation/assessment markets, ccnpanies 
have moved away from selling systems to experi- 
enced evaluators. In the process, enphasis 

had been placed on the relative ease of using 
camercial systems, thus giving the jjipression 
that vocational evaluators need be little more 
than technicians. 

3. In some instances training is limited. 

It often fails to address interpretive strategies 
and there is limited, if any, follow-up to insure 
that administration and use is standardized. 

4. Some corTTTiercia.l systems lack interpretive 
information and vocational relevance. This is 
a critical problem for evaluators who do not 
have the tinie or skills needed to conduct local 
job analysis or nonmtive activities. 

5. Many systcnti continue to suffer from question- 
able, or a Irick of reliability and validity 
studies. Ongoing research is frequently nonexist- 
ent or not geared to the needs of current users. 



6. Developer follow-*up with users regarding im- 
mediate and long-term needs is linuted and 
practitioners are not routinely consulted or in- 
volved in system research. 

7. With some systems there is poor quality con- 
trol in develqxnent, and replacement parts are 
different from the originals, thus potentially 
contaminating standardization. 

8. Somp drketers are more interested in the 
cormu.saj.on earned than in the appropriateness 
of the system to the purchaser. 

MARKEIER/DEVELOPER POSITION 

In addition to responding to some? of the 
service provider concerns, a number of issues 
were presented by Brandon and Lindsey and included 
in the following information. 

1. Ccmmercial system developers engage in activi- 
ties that practitioners and university programs 
do not or cannot do. These include surveying 

the field for its needs through extensive contact 
and follow-up, and developing and raintaining 
contact with business and industry in order to 
keep track of trends and needs. 

2. Through the use of their instruments, mar- 
keters have "chauffeured" the field of 
evaluation/assessment into schools and the private 
sector. 

3. Professional developers have made a signifi- 
cant commitmant to the field since bottom line 
profits are only around 15%. 

4. Betv-jn 5% and 9% of all sales are specifical- 
ly in the field of rehabilitation and the reroin- 
der are ouside of this discipline. In spite 

of this srrall market, corrmercial venders and 
developers continue to give allegiance to 
rehabilitation. 

5. Contrary to criticisms, follow-up of product 
sales is provided to purchasers of systems. 

6. System developers routinely cormit finances 
to new research and development, as well as 
ongoing research. 

7. Marketers did not speed up the process of 
vocational assessment, Federal law did. 

DEBME REBlfTEALS 

The succeeding statements were presented 
by the panelists at the conclusion of the debate. 

1. It was agreed that work sanples influence 
the definition of our profession and arc an ex- 
tension of our capabilities. 

2. Just as practitioners are often themselves 
instrument m^irkoterr,. in turn, system rrvirkctors 
frequently praiiote evaluation and assessment 
services. 

3. Regardless of the qualifications needed to 
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purchase and use work saaple systems, someone 
is going to conduct evaluation regardless of 
training or instrumentation. 

4. It is not as much the work sanplea but the 
interpretation eind accuracy of what is reccm- 
mended that carries the greatest inportance. 

5. Marketers must show responsibility in v^t 
they sell. 

AUDIEICE RBCX>MSM]tfVTIONS 

Concluding the debate, and questions and 
comments period the audience was divided into 
seven small groups and instructed to identify 
two problems and solutions (including responsible 
parties) that would address the issues discussed 
throughout the debate. It is interesting to 
note that the recorrmendations were geared more 
to the needs of evaluators and the profession 
than to marketer and developer problems. It 
was the consensus of the group that the problene 
associated with corrmercial evaluation systems 
could be minimized if they were in the hands 
of skilled professionals. Following are the 
major outcomes that have been synthesized from 
the simll group session. 

1. There is a shortage of adequately trained 
vocational evaluators to fill the available 
positions. Considerably more graduate programs 
in vocational evaluation/assessment must be 
developed with an enpliasis on locating them 

at universities in geographic areas currently 
devoid of such training. The need for more 
professional development institutes was consis- 
tently identified as a critical probleiT< area. 
These could be sponsored by VEWAA and other 
related professional groups, regional rehabilita- 
tion training programs, and univereity continuing 
education programs. It was recontnended that 
VEWAA consider applying for a national training 
grant to offer workshops in geographic areas 
with the greatest need. 

The pereonnel shortage issue could also 
be addressed by increasing the current salary 
structure to rake evaluator positions more ap- 
pealing to highly capable individuals. Massive 
recruitment efforts should be mounted by universi- 
ty programs to generate more qualified applicants. 
Coordinated efforts to increase the image and 
visibility of the field will assist with student 
and evaluator recruitment activities. 

2. Ihere is limited researt:h on instrumentiiLion 
and the eficctivenoss off evaluation/assessment 
services. Whenever possible, research should 

be conducted in cooperation with practitioners 
(in a variety of settinqs), evaluation system 
developers, and university faculty. Topics 
that should be addressed include: what is 
most iirportant to the consumer and referral 
source; follow--up on success rates and outcomes 
of evaluation clip.nt.olGf nonns and standardiza- 
tion? and, new rricxlels for evaluating difficult 
and underserved populations. Product research 
by practitioners, evaluation units, and univer- 
sity programs should be encouraged and funded 



through VEWAA rrdni-grants and gifts/grants from 
system developers. 

3. Greater involvanent from national oertifica- 
ticxi and professional organizations is strongly 
encouraged, it was x'ecomnended ttet methods 
for evaluating the evaluator be ixrproved and 

the certification process be changed accordingly. 
Efforts should be rade to increase broad national 
reccgnition for certification. Thi development 
of probationary periods for Bachelor's leA'el 
certification and other forms of provisional 
certification is also reccmnrended. 

4. A Vt<;WAA product approval board should be 
developed. Such a board could review and endorse 
evaluation/assessment products meeting high 
published standards. 

5. We should take more responsibility for our 
profession. All professionals need to be directly 
involved in identifying problems, promoting th.5 
field, rraintaining professional skills through 
regular training, supporting our professional 
organizations and certification body through 
memberehip, and constantly evaluating who we 

are, what we do, and who we serve. 

6. The field nust almys ensure that quality 
sezvioes are being offered. Some programs are 
not concerned with, or even aware of, what 
"quality" evaluation/assessment services aie. 
Training should be offened from the tog dawn 
so t\vxt administrators can appropriately set 
"informed" policy for the provision of hi^^ily 
beneficial vocational evaluation services. 

cocmsiON 

Developere and practitionerc* should take 
time to better understand each other in order 
to work toward the goal of more effective 
assessment/evaluation services for all populations. 
An iirportant part of this cooperative working 
relationship is the willingness to participate 
in appropriate training and research. Until 
such a two-way relationship can be developed, 
the problems identified in this paper (whether 
real or perceived) will never be fully resolved. 
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ETHICS CHraCK: ARE YOUR EJTHICS UP TO DATE? 



JUDITO K. EARLY 
DRI., STEVEN riHOMAS- 
BARBARA H/.-AZZAM -^ rODERATOR 



ADstract 

The following is a sunmary of the General Session 
presentid at the Fourth Forum on Issues in 
Vocational Assessment. 



Ms. Early spoke to current ethical and 
professional issues in Vocational Assessment. A 
br ief d iscussion of morals was followed by six areas 
of concern: 

1. Re^xmsibilit^ - accountability to 
clients being served and responsibility 
to report unethical practices to the 
proper authority. 

2. Professional Onpetenoe - ability to 
understand and interpret infonnation to 
clients^ working knowledge of the world 
of work and familiarity with human 
behavior studies. 

3. Confidentiality - privacy for clients by 
sharing information only with parties 
named in writing and approved by the 
client. 

4. Intec[MK>fe88ional Relationships - the 

use of networking among peers and related 
professionals for the most desirable 
outcome for clients. 

5. Publishing - transmitting valuable 
information to other professionals 
ultimately affecting the growth and 
development of this profession* 

6. Oonsultation - this should only be 
undertaken by qualified professionals in 
the oontext of their area of expertise. 

Ms. Early further discussed the concept that a 
Code of Ethics actually attempts to provide a 
conscience for the discipline and its practioners 
as expressed by Julian Nadolsky in 1986. The need 
for more concise definitions of ethical behavior 
was also discussed. 

Kitchner's five guiding principals of 
resolving ethical delimas were discussed: 

1» Autonomy - making one's own decisions. 

2. Fidelity or Loyalty - being faithful and 
keeping promises. 

3. Justice - equal or unequal treatment 
based on the problem. 

4. Nonmaleficence - avoidance of causing 
harm. 

5. Beneficience - desire to do good for 
others. 

As society and the field of Vocational 
Evaluation changes over time, old solutions and 
techniques become obsolete* For this reason the 
development of a Casebook to further define and 
develope the principals set out in the VEi^AA Code of 
Ethics is urgently needed. 

Please refer elsewhere in this publication to 
Ms. Early's paper: "Ethics in Vocational 
Evaluation: A Foundation for Future Study". 

Dr. Steven Thomas followed by speaking on 
CCWAVES's recently developed Cbde of Ethics. This 
code is somewhat more complex and specific than the 
VEWAA Code of Eth ics • Var ious groups inclufi ing the 
VEWAA Ethics Conmittee, were asked for review and 
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comments prior to adoption o£ the final document « 
Itie caWJFS Code o£ Ethics is made up of three 
levels: 

1) Tsmta which are general principals 
shared by all three professions. 

2) Stantacds which further define the 
Tenets. 

3) Guidelines which insure greater 
understanding of the Standards and 
provide a functional method for 
determining ccmplianoe with the 
ethical principles inherent in the 
Standards and Tenets. 

Dr. Thomas briefly discussed this document 
furt)ier before turning to the issue of ccmplianoe 
ar>d enforcement. He stated that all the work 
undertaken by OCmvES was being reviewed by an 
attorney to determine whether it would be legally 
enforceable. If this is the case OCVAVES plans to 
adopt processes similar bo those currently being 
used by other professional licensing and certifying 

Boards and OonwLiMic^^^ 

Discussion fron^ the audience produced the 
understanding that if a person against who a 
complaint has been filed is not a member or 
certified by the Cornmission then neither OCVAVES or 
VEMM would have any jvirisdiction to sanction their 
behavior or actions. For this reason it is 
'extremely important to support certification and 
Professional membership as a means of insuring 
quality^ ethical services. 

It was briefly discussed that there are 
: currently lawsuits which have been filed against 
Rehabilitation Professionals questioning their 
ethics. To date one of these suits has been 
dropped. This situation further supports the need 
for continuous discussion among members of ethics 
and the ongoing need to maintain Malpractice 
Insurance. 

Finally^ Mrs. Azzam discussed the current 
projects of the Ethics Coimlttee. A Conflict of 
Interest Policy has been developed for the use of 
the VEWAA Board and will be reviewed at the next 
Board Meeting . A casebook is also being developed 
to addresa ethical delimas and solutions. 
Volunteers to work on this project wete solicited. 

This general session was well attended with 
active participation o£ the attendees. It provided 
food for thought as well as valuable information. 
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'Redefining the Client, Rxp/jnclinH the Evaluator^s Kolc" 



Rock Weldon, MA 
Ciilo C, CLhson, MA 



ABSTRACT 

Vocational Evaluator?^ are traditionally 
employed in facilities or evaluation 
centers where t^eir main focus in to provide 
services tc persons of disability, or to 
injured workers, Their primary efforts 
are to ad:ninister and interpret test results 
and/o: work samples, ^o that jobs and 
career paths are identified in ways that 
withstand the severest scrutiny and 
challenge. 

This pnpo.r explores the idea 
shifting the ICva.'.uator * a focus towards 
working more closely, and having more 
direct contact with the employer. 

Possible benefits may include: 
(a) better services to the person of 
disability, or injured worker, (h) hnprovcci 
pJucemcnis, (e) greater utilization of the 
:lob analysis and job modification skills 
possessed by Evaluators, and (d) promotion 
of a more team-oriented approach between 
the Employer, Counselor, Evaluator and 
Job Placement Specialist. 



IJjraOJHICTION 

Historically vocational evaluation 
has been a part of the rehabilitation 
process, taking place in employment settings. 
More recently evaluations are becoming part 
of school programming and are becoming more 
and more prevalent in the private for profit 
rehabilitation area. Still many evaluators 
have a limited, tradition bound view of what 
constitutes a proper evaluation, and have 
become rather rigid in tneir ability to 
Renernli'/.c to other poluTat'ons (Edgcomb , 1986) . 

Examining the knowledge and performance 
areas in the Standards and Procedures Manual 
for Certification Maintenance (CCWAVES, 1987), 
it is rather obvious that most Evaluainrs 
do not consistently utilize the majority of 
(hoMO skills that provide us wllh a 
profoHslonai edge. Job auaiyHis, occupaiioual 
information, adaptation of jobs and 
vocational training are probably the skills 
most undc. utilized. 

For the past several years professionals 
in the field ol' Vocational Eva luatlvv..a have 
begun to analyze the future of the profession. 
Citing disturbing trends which... suggest 
that vocational evaluation... may be a dying 
discipline, McDaniel (1987) sends a clear 
message that we cannot ignore. Steps must 
be taken to nurture the existance of this 
field. McDaniela' dying discipline scenario 
provided a departure for answering '*why" and 
"what to do questions" at VEWAA's Third 
National Korum in Clearwater, Florida, A 
signifJcont number of participants felt 
that there were a number of "professionalism" 
challenges that ought to be taken up. Others 
felt that a lack of organization, inadequate 
funding, identity crises, and incompentance 
more clearly described vocational evaluation's 
problem. For still others, credentlaling 
and licensure, political action and marketing 
to the muJ ti-disclpliiuiry team became 
prescription for chango., and the list went on. 
There was, however, no formula that would 
increase the demand for vocational evaluation 
services. 

DISCUSSION 

Posnibly (Edgcomb, 1986) comes closest to 
the heart of the matter when she says that we 
need to take a look at the systems outside of 
rehabilitation and adjust our services to meet 
iho i\chhIs of the clientele. Sawyer ( 1987) 
helioven that vocational evaluation should have 
an advantage in the marketplace because of its 
track record. If vocational evaluation's 
rlMhtliil place In the hierarchy of human 
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services has not yet been assured, then we 
must aFk ourselves why. 

When targeted markets do not buy, the 
product/service has not been sold; It's a 
simple truth, but knowing the truth does not 
set us free. Why a product/service does or 
does not sell Is always problematic. Of 
course, there;8 also the possibility, as with 
any noncompetitive offering In a competitive 
market, that the product/service's life should 
die a natural death. In the case of 
vocational evaluation, we don't believe the 
time has come. For us, the truth must then 
be lodged somewhere In the fact that the 
service has not been successfully sold to 
the targeted markets. 

Economists focus on supply-demand 
relationships to determine and recommend 
logical courses of action. Enterprcneurs 
rigorously analyze needs In a effort to 
forecast and acquire adequate return on 
Investment. Product and service distribution 
strategy demands realistic analyses of 
perceived need, an efficient response vehicle, 
and understanding of competitive strength 
In order that the provider of goods and 
services remain viable* Whv should It be 
any different for vocational evaluation? 

We recommend a close and detailed look 
at the economic drivers that compel 
evaluations be performed with the 
comprehensiveness for which our training 
prepared us. Two such drivers. Reasonable 
Accommodation and the Graying of the Workforce, 
stand out as viable nitches in which 
vocational evaluator's skills can be readily 
applied and are sorely needed* 

Employers are beginning to realize that 
It makes good business sense to get Injured 
workers back to work. A recent worker 
compensation case In the state of Washington 
Is Instructive; Julius Reese was receiving 
treatment for clironJc foot pnin wivilo worklnj; 
at Sears, Uobunk & Company, The treating 
physician released Reese for ''lighter" duty 
work. Sears denied Reese, unless he could 
return to work in his "full capacity" with 
a full medical release. Reese brought suit 
against Sears alleging the employer "had 
failed to reasonably accomodate the 
handicapping condition." The Washington State 
Supreme Court found that tlie Industrial 
Tnsurnnce Act stood separate and apart from 
the laws against discrimination and the two 
remedies were separate and distinct. They 
found also that Keese had suffered two 
separate injuries: a workplace physical 
in jury and a subj^cquent Injury arising from 
lUv tMn()l()ytM''M .iMcj'imI linnd i imp rl I r Im i n.'iU on 
(IJruckor» 19H7). 



The graying of the workforce in the 
United Stated is a well documented phenomenon 
(Eleventh Mary Swltzer Memorial Seminar, 1986). 
Employers are beginning to realize that not 
only is the workforce graying but there is 
going to be a smaller number of people 
available for the workforce as we begin to 
experience the aftereffects of the "Baby 
Boom" generation. 

To cite the obvious from a different 
perspective, employers need the expertise of 
vocational evaluators to reduce the real 
liabilities they face. The training and 
experience evaluators bring to the table 
can be very useful for employers in trying 
to accommodate the special needs of the 
graying workforce. Recent discussions 
concerning the meaning of the court case as 
well as the changing workforce can be 
summarized as follows: 

a. Compels employers to know much 
more about the requirements of 
their jobs than before (job 
analysis) , 

b. Compels employers to know what 
other jobs their employees can 
perform in the event that an 
Injury prevents thrir return to 
the job of Injury v transferable 
skills analysis), and 

c. Compels proactive and aggressive 
measures be taken by employers 
to accommodate the needs of 
Injured (dlnnhlcd) workers wUli 
respect to returning to work 
with the employer of injury 
(matching the abilities of workers 
with demands of jobs). 

PERSPECTIVE: Client, Product and Service 

The "iiKjrkc't lug*' .-ippronch to lUv 
distribution of goods and services has 
been developed into an extremely success- 
ful discipline. As it ..pplles to 
Vocational Evaluator's some adjustment 
is required in the typical rehabilitation 
professional's thinking: 

"We cannot ignore the fact that this 
success was built on the basic 
premise that the customer ts at the 
absolute center of the marketing 
program. In fact, the marketing 
philosophy InKists that every 
facet of tlie marketing effort be 
built around the customer. Thus, 
for our purposes, the employer Is 
viewed as 'prcwhut' (Niiu^lh 

Institue on Kehal) I I i Lnt ion Issues'), 
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Tt may be objectionable to some vocational 
evaluators that we call an employer "customer" 
and that: we call a potential worker "product" 
but for the sake of orientation perspective, 
it is helpful. As witn any marketing 
endeavor, our products (workers, job seekers) 
must appeal to our clients (those who buy 
our products: clients/customers) or the sale 
(filling the job opening)^ is not accomplished. 
The "value added" that sells our products is 
the service we supply. We can increase 
the value of our product through training 
and counseling. We can more comprehensively 
sorvt^ the. iuhhIh of our customers when wc 
understand their needs (job requirfcjments, 
analysis) . 

SUMMARY 

McDaniel and Sawyer have very thoroughly 
ut lined the problems and some possible 
solutions for the field of Vocational 
Evaluation. One possible solution they 
may have overlooked, however, is to increase 
the demand for vocational evaluation services. 

First, it is recommended that 
Vocational Evaluators better utilize the 
skills that are most unique to them, that 
is, job analysis, occupational information, 
adaptation of jobs and vocational training. 

Secondly, we need to embrace a more 
"marketing" oriented approach in which we 
shift our focus from the client as a customer 
to the client as the product. 

Appro.iching tlu^ clulivt»ry of vott.-it I oiui 1 
evaluation services in this manner should 
greatly enhance services to disabled workers 
and will promote a more team-oriented 
approach between the Employer, Counselor, 
Evaluator and Placement Specialist. 
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PROFESSIONAL CONTACTS FOR EVALUATOR ' S EXPANDING ROLES 



LYNN ROTHACKER DOWD, M.A., CVE 



Abstract 

In recent years, changes have occurred 
In the types of vocational assessment 
services provided, the populations 
served, and outcomes for the Individuals 
who are recipients of assessment 
services. These changes have resulted 
In a significant role strain on hhft 
professional evaluator and highlight the 
need for collaborative effort with other 
professionals and the promotion of a 
broader view of evaluator *s expertise. 
To meet the current challenges, 
vocational evaluators must develop 
skills In communication, collaboration 
and negotiation. These skills are 
essential In both program development 
and the resolution of ;<peclflc client 
cases . 



ItLfi. Chaaglgcj. Profile q± vocational 

The scope of the field of 
vocational asseB^rnent has changed 
dramatically In recent years. According 
to Sawyer (1988), the need for 
assessment services have expanded as 
"markets and service settings are being 
identified in every sector of 
society. " (p.9 ) As these new 
directions are found, "the role and use 
of assessment Information is likely to 
be in constant change, causing reshaping 
o£ practice and delivery" (Menz, 1987, 
p. 68). For the field of vocational 
assessment, this widespread change poses 
a challenge in retaining Influence over 
services as we II as the competency, 
qualifications, and professional 
Identification of the practitioners who 
provide them. For the practitioner, 
these changes pose a significant role 
strain and require the dfivelopment of 
many new essential skills. 

Many professionals entering the 
field still do so without prior 
training. These individuals generally 
acquire the knowledge and skills to meet 
the technical res pons ibilltles of their 
position through on-the-job triining. 
This training enables them to become 
skilled technicians but does little to 
empower them to extend beyond that role. 
Undergraduate and graduate programs 
inform students of field advances, 
however , course work emphasizes the 
acquisition of technical skills and does 
not provide students with the persor al 
deve lopment oppor tun ities necessary to 
meet the dem:»nds o£ their changing role. 
This Is tri.ti of short term training 
programs as well as degree programs , 
Training opportunities, both degree and 
non-degree are not only limited in 
scope, they are also limited in number. 
Thus , the onus is placed on the 
professional to develop the; skilU, 
necessary to meet the demands of: their 
professional role . 

The forces impr:jctinq on the field 
and its contil: i lue II tr» have hn on 
identified by a number of professionals 
(Ayella & Leconte, 1988; McDaniel, 1986, 
1988; Menz, 1987; Sawyer, 1987 ). They 
or iq incite both within and outside of. the 
field and ifpply f undamen ta 1 crranges i n 
popu Id I: i ons , r^ory ico d^j 1 I ver y , and 
outcomes of the assessment process. 
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Porhaps; one of the greatest shifts 
In service delivery Is extending 
assessment services to populations more 
severely disabled than those who 
traditionally have been served. 
"Advancements in medicine to diagnose 
and treat many formerly untreatable 
health problems have brought many new, 
and more severely disabled persons into 
vocational appraisal settings" (Ayella & 
Leconte, p. 21) Federal priorltits 

have emphasissed the rehabilitation o£ 
•difficult to serve populations, J^uch as 
Pv^^rsons with traumatic brain Injury 
(VBI). Traditional assessment 
approaches have not proven particularly 
e££v'?ictive for this population and 
evaluators necessarily have relied on 
information from other professionals 
inclucUng doctors and therapists to help 
develop and refine suitable assessment 
techniqaes. Deinstitutionalization has 
brought many individuals who are 
severely disabled to assessment settings 
as well. These individuals, again, post 
a challenge to the evaluator in the 
development of appropriate materials and 
Innovative ix^ervice models to meet their 
intensive nev'^ds. Most evaluators lack 
special training related to individuals 
with TBI, thowe who have been 
instituitionaLUed and other severely 
disabled populft'tions . For any 
population, esp^'^tcially those difficult 
to serve, collaboration among 
professionals is essential. 

Changing demographic factors have 
resulted in an increase in individuals 
with cultural and/cr language 
differences in our ixociety. Because 
their educational, t.vraining and 
employment needs may be difficult to 
Identify, many are binding their way to 
assessment settings. At present, most 
programs are ill-equi with 
the unique instructional needs of 
Hispanic, Asian, and other ethnic 
groups. Some commercial i\>sses8ment 
tools now provide Spanish directions, 
however, this is a very sm^ai step to 
meeting the comprehensive nv'^eds 
assessment needs of this population. 
Language proficiency, an understanding 
of the work ethic and behaviors of other 
cultures are skills which must be 
acquired by the evaluator. Professional 
resources such as translators and 
cultural experts are necessary to make 
ar>sessment services applicable lor these 
populations . 

Individuals who can benefit from 
assessment services will continue to be 
identified In increasing number. 



welfare reclpU-»nt3; displaced workers. 
Acquired immune Deficiency Syndrome 
(AIDS) patlentS; substance abusers, 
senior citizens, and individuals who are 
just interested in changing careers s.ire 
among the growth populations for 
vocational assessment. Evaluators will 
need to rely on the expertise of other 
professionals as they continue to define 
and refine services appropriate for 
particular populations . 

Chanoinq Services 

Referrals for assessment services 
are made for a variety of reasons each 
with an associated service model, a 
desired set of informational outcomej, 
and a group of professional contacts who 
shape the process. 

**ln schools, vocationcil appraisal 
services are conducted to help insure 
appropriate placement of students for 
successful vocational programming, to 
plan vocational development and to 
facilitate the transition f;com school to 
work.*' (Ayella & Leconte, li)e8, p. 22) 
The evaluator 's role in schools is quite 
different from other settings. 
According to Neubert (1986), evaluators 
in schools often act as advocates for 
students in the vocational placement 
process, assist with the recicuitment of 
students ^or vo-tech programs}, and 
provide in-class support to vocational 
instructors. To accomplish this, public 
relations efforts on the part of the 
evaluator were viewed to be essential. 
They "enhanced the Implementation of 
vocational recommendations and helped 
handicapped students gain access to 
vocational education." (p. 103) The 
emphasis on transition services now 
extends the school-based evaluator *s 
public relations efforts beyond the 
school into the community. 

In public and private non-profit 
rehabilitation, evaluators must be aware 
of the range of employment and community 
service options available locally 
because the needs of the populations 
they generally serve are nuite diverse. 
Ongoing liaisons with service providers 
are necessary to determine current 
program offerings, program availability, 
funding sources, and specific client 
eligibility. 

When assessment services ar( 
provided In pr ivate-f or-prof It 
rehabll 1 tat Ion, Workers * Compensat Ion 
and Social Security cases, the focus is 
placed primarily on settlement. "The 
economics of wage earning potential, 
wage loss, and costs of successful 
return to work are critical for these 
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ciqenclos." (Aye 11a a Leconte, 198B, 
p. 22). In these cases, collaboration 
with attorneys, insurance 
representatives, economists, and a 
variety of others professionals often is 
necessary. 

Federal initiatives also have 
altered models of: vocational assessment 
service delivery. Supported employment 
and school-to-work transition, which 
emphasize community involvement, place 
less importance on comrrsrcial 
instrumentation and greater weight on 
informal assessment in actual employment 
settings. The clinical skills of the 
evaluator are essential in the creation 
of viable community basad assessment 
alternatives. These techniques 
offer possibilities which exceed those 
provided via commercial tools. For 
practitioners working in this area, 
information sharing and collaboration 
with employers, other community based 
personnel and parents is necessary. 

In medical rehabilitation settings, 
evaluators work in cooperation with 
therapeutic and work hardening programs 
to determine appropriati^ vocational 
alternatives should an individual not be 
able to return to his/her previous 
position. Collaboration with doctors, 
physical and occupational therapists, 
rehabilitation nurses^ and social 
workers enable the comprehensive needs 
of the individual to be addressed. 
More important than collaboration in the 
assessment and recommendation process is 
consultation prior to assessment to 
ensure that assessment activities which 
potentially may harm or add injury are 
not included within the evaluation plan 
for that individual. 

Field developments also have given 
rise to new assessment models such as 
curriculum based vocational assessment 
(CBVA) . In contrast to other assessment 
services^ CBVA is an ongoing process in 
which informal assessment procedures 
directly linked to curriculum 
competencies are implemented by a 
variety of personnel who provide 
vocational and special services to 
special educaMon students (Albright & 
Cobb, 1988). CBVA is a concept which 
can be integrated into community 
colleges, and job training programs in 
addition to school systems. At pro.sent, 
a jcole for vocational evaluators in the 
profu^ss is not Identified. Evaluators 
have particular expertise in the 
development of checklists, observation 
rating forms and other vocational 
assessment inst rumen tat ion . Th is 
expertise in conjunction with that o£ 



curriculum expurtti would rejuult, in a 
highly effective CBVA process. 
Evaluators also can provide training to 
educators responsible for CBVA 
Implementation on observation and 
related assessment techniques. Thus, 
evaluators require negotiation skills to 
convince educators of their potential 
contribution to the process. 
Collaboration skills are needed to 
maintain effective working relationships 
with teachers, administrators, 
curriculum specialist and other school 
personnel throughout the development and 
implementation of the CBVA process. 

Technology has had a significant 
impact on assessment services. 
Computerized aptitude assessments which 
provide a quick and easy screening are 
being used in an increasing number of 
assessment settings. These are not 
appropriate for all populations and, 
thus^ require careful selection and 
interpretation. Evaluators must convey 
the limitations of these tools to 
counselors and other referral sources to 
insure that misinterpretation or over 
interpretation of the results does not 
occur. Other technological advances 
such as computerized reporting and job 
search programs contribute to quality 
time-efficient services. These advances 
make keyboarding and computer literacy 
necessary skills for evaluators. 

Another change in service delivery 
is short term assessment. This model 
was developed in response to Increased 
emphasis on quantity and cost 
effectiveness. Short term services are 
appropriate for many individuals^ yet 
inappropriate for individuals with more 
intensive needs. Evaluators must use 
care in selecting services as it 
inefficient to provide a comprehensive 
evaluations for individuals who need 
only short term services and ineffective 
to apply short term assessment tc all 
individuals. The ability to make such 
distinctions in service delivery relies 
on the vocational evaluator's 
communication and problem solving 
capabilities in dealing with counselors 
and other referral sources* 

Ctianqinq Outcomes 

To keep servicoc relevant, the 
field of vocational assessment must 
adapt it& techniques to the range of 
employment and service opportunities 
aval lable in the communi ty . 

In most areas of the country, 
employment In industr ic*l manuf actur ing 
is declining and opportunities in areas 
such as communlcati onfi and the service 
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industry are incrccislng. Many of our 
commercially available a55£>or.r^menl l.oolis 
do well at assesslnq skills for 
industrial, mechanlcca and bui;lne!: £j 
detail occupations, but provide 1 .ttle 
information related to potential for 
employment in other areas. Materials to 
assess abilities for jobs in 
professional or managerial areas are 
virtually nonexistent. The failure to 
keep pace with changing labor trends 
have resulted in less than optimal 
service delivery In many ass'jssment 
settings. The evaluator ultimately Is 
responsible for the quality of services 
and needs to provide guidance to 
commercial publishers and developers. 
Through advocacy, evaluators can 
encourage the deve lopment of appr opr late 
vocational evaluation strategies and 
techniques . 

The range of vocational service 
options has Increased greatly In recent 
years as has the definition of who Is 
employable. Supported employment has 
enebled meny severely disabled 
individuals full participation In the 
work force. A few years ago, these 
individuals wouH have been served In 
sheltered workshops or day activity 
centers If they were served at all. In 
fact, many of these Individuals who are 
now successfully employed were deemed 
ineligible for state vocational 
rehabilitation services due to the 
severity of their disability. The 
opportun' uies now available place 
increased emphasis on evaluator^s 
abilities and skills In determining 
supports and accommodations to 
facilitate successful Integration Into 
the work force. Assessment outcomes 
which eliminate the potential for future 
participation In the work force are no 
longer acceptable . 

As technology has changed 
assessment practices, it also hd'3 
changed the employment alternatives 
available to Individuals. Computers, 
adaptive devices cuul other tecrhnolocjical 
advances. In part, have provided the 
means for Individuals with severe 
physical or sensory disabilities to 
become employed. These adaptations 
range from relatively inexpensive 
adaptations such as a software program 
to enable an Individual with one hand to 
press several keys on the keyboard in 
sequence rather than simultaneously to 
expensive devices to enlarge print on 
the video display terminal or provide 
voice output for Individuals with visual 
impairments. Evaluators must keep pace 
with these important innovations so that 



their lack of awarene:5s does not pose 
harrie.-j; l.o their client's luturtr. 
Rehabilitation technoloci ists cind 
engineers will rcjqulro consultation to 
ensure that all potential options arc- 
explored for ind i vidua 1 cl ienti*. . 

The Changing Role o£ the Practitioner 

It is imposrible for pract:it loners 
to remain untouched by the^se fundamental 
changes. A reexamination of our 
traditional rolo, the competencies and 
qualifications of professionals, and the 
status of our field has become 
Increasingly critical. 

The role of the evaluator always 
has been a complex one. Hundreds of 
competencies were identified for 
practitioners in the late 1970*s 
(Coffey, 1978 ; Sink, Porter , Rubin, & 
Painter, 1979) most, If not all of which 
are applicable today. Many of these 
competencies cross occupational lines 
and relate to the skills required of 
rehabilitation counselors, occupational 
therapists, job placement specialists, 
special educators, vocational educators 
and career development specialists. Due 
to the crossover of skills, it always 
has been necessary for evaluators to 
demonstrate how their role was unique. 
Evaluators did so by emphasizing the 
tools and techniques they utilized. At 
present, many of these techniques are 
out-dated in view of the present changes 
In populations, services and potential 
outcomes. Evaluators are unique because 
of their knowledge and expertise not the 
tools, techniques, or process they 
utilize. Evaluators are knowledgable 
about work and expert In analyzing, 
synthesizing and Interpreting 
information related to work and persons 
with vocational handicaps. 

In many instances, supported 
employment and curriculum based 
vocational assessment personnel do not 
see a role for the vocational evaluator 
in their service model55 because the 
techn iijues wh Ich hav^i been uAOd 
traditionally do not meet their needs. 
This narrow view of ths role of the 
vocatloral evaluator, if not promoted by 
the profession, certainly has not been 
refuted by It. By not attempting to 
change restrictive views o£ the 
evaluator 's role, the profession is 
viewed as not keeping pace with change 
and is in effect threatening its own 
existence. It is essential tcr 
vocational evaluators to take a broader 
view of tlielr profession and to acquire 
new skills {(?.g. negotiation) which will 
make them valuable pla^'ers in markets 
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which presently do not: see Lhe benef.'U 
of l.hia i r rontr I but Ions . 

Ihji Kv<ilucLt;.<2iL ^ an 

According to forecaster John 
Naisbitt, "We are moving from the 
specialist who is soon obsolete to the 
yenerallat who can adapt." ( 1982, p. 32) 
In vocational assessment, adaptation to 
changes In population, services and 
outcomes is essential for the profession 
to survive. The vocational evaluator 
must both view and market 
himself /herself a; a general 1st In order 
to be perceived likewise by other 
professionals. By so doing, the 
evalUuuor stands more of a chance In 
retaining a place in overran service 
spectrum* 

Vocational evaluators, as appraisal 
generallsts, are Individuals who 
analyze, synthesize and Interpret 
Information In relation to vocational 
outcomes. They develop approaches to 
measure vocational potential and work 
cooperatively with other professionals 
to provide Integrated service delivery. 
It Is the ability to utilize the 
Information and expertise of other 
professionals and to cooperatively 
provide services that has been most 
overlooked by vocational evaluation 
professionals. These skills and 
competencies axa not new. They do take 
on Increased Importance today than In 
previous years. 

Professional contacts/Resource 
Utilization 

Sink, et. al. (1979) identified a 
number of competencies under the topic 
of essential resource utllizatlor which 
due to present changes in the fiald 
deserve Increased emphasis at this time: 

o "Can establish Inter/lntra 
professional contacts with 
Individuals and agencies" (p,38) 

o "Can demonsl. ite "where to start" 
In acquiring information or 
materials. »" (p. 38) and 

o "Can use community services and 
resources in meeting problems ... and 
maintain an ^Elective relationships 
with each" (p. 39 ) 

Although these competencies were 
important at their inception, they have 
become fundamer^tal in ena' ling 
^valuators to meet the increasingly 
complex demands of their role. As 
evaluators move into situations in which 



traditional mo .els of assessment are no 
lunger optlnui], skills In communication, 
cullaboc^tion jiuJ ne«.}ot idt Lon bt^como 
increasingly important. 

More recently, Lhese skills have 
been emphasized by the proposed Code of 
Ethics of the Commission on 
Certification of Work Aclju.ytmont and 
Vocational Evaluation Specialists 
(CCWAVES) (Thomas, 1989). Tenet 4 of 
this document states that "Inter- 
professional cooperative relationships 
shall be seen as vital in achieving 
optimum benefits for clients. 
Professionals shall respect the value 
and roles of professionals and staff in 
other disciplines and act with integrity 
in their relatlonr.hlps with professional 
colleagues, organizations, agencies, 
referral sources and related 
disciplines." A principle which is 
highlighted under Tenet 4 is that 
"Professionals will actively seek other 
professional assistance or support In 
providing the best services for 
clients." To accomplish this, vocational 
evaluators must seek the input of other 
professionals both related to the 
resolution of specific cases and to 
develop appropriate and effective 
programs and services. 

£l£uiaiU-taJ;J.QJi Relfltfi(3 Lo. specific Qsxsji^ 

Evaluators have traditionally 
collaborated with other professionals 
related to specific Individuals they 
assessed. in the Interdisciplinary team 
approach, cooperation and collaboration 
was essential for the development of a 
rehabilitation plan. Generally, the 
expertise and Involvement of other 
professionals was requested at the time 
recommendations were developed or at Lhe 
time of the post-evaluation staffing. 
The present need for collaboration and 
Information acquisition extends beyond 
the Interdisciplinary approach and 
Involves consultation prior to, during 
the assessment process and at the time 
recommendations are made. 

With the range of services 
available to Individuals with severe 
disabilities, Informatic In addition 
to that which is obtained through the 
interview and assessment, is required. 
Contacts such as parents, Leachers, 
group home supervisors and other 
individuals can provide information 
essential in determining the 
appropriateness of specific program 
alternatives. Involvement of these 
individuals in the assessment process 
greatly enhances the utilization of 
recommendations and consequently the 
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success of the individual who its served. 

Evaluatots must develop contacts 
for acquiring information on 
technoioc|ical adaptations and job 
modifier cions for individualB with 
severe ghysical or sensory disabilities. 
If possible, these devices or techniques 
should be utilized during the assecamont 
process to improve the validity of 
recommendations . 

Bv'aluators need constantly to 
update information from community 
programs and services. Visits to these 
programs can be invaluable in 
determining which individuals are best 
able to benefit from the services which 
are offered. Ongoing contact with 
program staff will enable the evaluator 
to keep informed of program and staff 
additions and changes. 

Conflultjitiftr. for Program Devf>lnpmftnt 

The area of program development is 
one in which evaluators traditionally 
have not relied much upon the expertise 
of other professionals. With changes in 
populations, services and outcomes, many 
of our present assessment programs 
require remodeling. The expertise of 
other professionals in this process can 
be highly advantageous . 

Aagftflflment Materials Dpyftlopment . The 
development of worksamples is one of the 
traditional ways evaluators have relied 
upon the expertise of other 
professionals in program development. 
Evaluators have gone to business and 
industry professionals or vocational 
instructors and developed tools to 
aasei^s job specific skills. The range 
of assessment materials to be developed 
in the wake of the significant changes 
in the field extends well beyond that of 
the worksample and requires the 
collaboration of many professionals. 
Skills checklists, behavior rating forms 
and other materials must be developed 
for specific: application in CBVA, 
conuTtunity based assessment, and other 
assessment models. 

Updated labor market information 
aids vocational evaluators in choosing 
from available assessments those which 
will determine an individual's 
appropriateness for particular 
employment or training opportunities. 
This information also can guide the 
development of Informal criterion 
referenced materials geared specifically 
to job demands. For example, a task 
requiring the computation of elapsed 
time is developed for a clerical 
position In which an individual must 



procesii the time cardn of hourly 
employees. Consultation with vocational 
instructors can did evcjluators in 
determining the level of reading 
materials used in vocational training 
programs . For instance^ functional 
assessmentfs o£ reading compr ehnn^^ion 
using material from the actual course 
texts can enable an evaluator to better 
determine If an individual will be 
successful in meeting the demands of a 
particular area of study. 

tlOlLLllSL wUggent Materials UqJH^ 
Measurable ayii Meaningful . Another use 
of professional contacts is that of 
selecting, modifying or supplementing 
the assessment materials currently 
utilized by the vocational evaluator. 

Evaluators can rely on vocational 
instructors and employers to select 
among the available assessment tools 
those which accurately identify skills 
which are utilized in their vocational 
area. The modification of assessment 
tools and material to better represent 
particular vocational areas or job 
skills should be accomplished with their 
input as well • 

Evaluators can enhance their 
program by making physical measures more 
objective. Tools which are designed to 
assess physical capacities are, by 
nature, physically demanding on the 
evaluee yet evaluators have done little 
to determine levels of exertion or 
potential health risk. Physical and 
occupational therapists as well as 
nurses can provide evaluators with much 
needed guidance in this area. Some 
examples of ways these professionals 
have aided in program development are: 
the use of a cardiac screening checklist 
to determine potential health risk prior 
to the administration of a physically 
demanding assessment, pulse rate and 
blood pressure measurements taking 
before during and after a physically 
demanding assessment and the use of a 
volumeter to objectively measure edema. 

Assessment Enviionment . Increasingly, 
evaluators will find themselves working 
in classrooms, businesses and Industry, 
community based programs as well as 
other non- traditional settings . A 
flexible approach as well as the 
identification and utilization of 
available professional resources is 
necessary to meet the demands of the^^c 
new environments. 

Evaluators who continue to work in 
unit-based settings can rely on 
professionals from business and Industry 
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to assist in the lay out and desl«^n oE 
thc-ir facility. These pr of ei3slont<ls can 
enhance the overall appearance of the 
unit making it more closely approximate 
the standards found within the 
cornmuni ty , 

Occupational therapists^ er gonornic: 
specialists, and industrial 
psychologists can provides suggestions 
on layout, lighting, table and chair 
height, and work posturing. Input from 
these professionals will not only make 
the environment safer, but may improve 
the performances of the individuals 
assessed • 

AJLfiiUL Addgggged l^y Pro gram , Local 
labor market information should guide 
the overall service delivery of the 
assessment program. It is of little use 
to have high quality assessment tools 
and materials if they do not assess the 
skills required for the employment 
opportunities which are available 
locally. Job placement specialists, 
personnel from state and local 
employment agencies, members of the 
chamber of commerce, and occupational 
statisticians can aid the vocational 
evaluator in tailoring assessment 
services to local opportunities. By 
consulting such experts, recommendations 
can be specific and up-to-date, 

Conclualonfl 

The utilization of professional 
contacts and resources in vocational 
assessment has become increasingly 
critical given the changes in 
populations/ services and outcomes. 
Vocational evaluators must utilize any 
and all professional resources available 
to them to improve the quality of their 
vocational assessment programs and the 
outcomes for the individuals who are 
served . 

The barriers which traditional 
vocational assessment techniques have 
posed to their profession and their 
professionalism must continue to be 
removed by vocational evaluators. 
Marketing efforts must emphasize general 
skills of the vocational evaluator as 
well as their ability to successfully 
integrate assessment techniques into a 
variety of programs and settings. 

The significant changes in the 
field imply increased emphasis on the 
development of communication, 
collaboration/ and negotiation skills. 
In addition to including these within 
their Code of Ethics, CCWAVES should 
incorporate these critical skills into 



the Essential Knowledge and Performance 
Areas . Professional training 
opportunitioLs, both duijree and non- 
degree, which have not addressed these 
areas must do ?io in the future. Future 
training al.s;o must emphasize the 
acquisition of general vocational 
appraisal skills and the application of 
these skills to a variety of services, 
populations and settings. These 
approaches will enable professionals to 
better meet the demands of their 
changing role than the present emphasis 
on the acquisition of technical skills 
required to employ traditional tools and 
techniques in vocational assessment. 
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VOCATIONAL EVALUATORS AND THE LAW 
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ABSTRPCT: 

VOCPTIONOL EVftLURTORS PND THE LPW 

In the ever expanding ^ world of 

testing and *^he laws which regulate 

it, and in this age of "easy" 

suing, it is imperative that 

evaluators and counselors be 

coqnizant of their liability as it 

relates to testing and resulting 

recommendations. ftttorneys are 

beginning to do their homework on 
vocational evaluation and the 

instruments used, and it is not 

uncommon for the attorneys to - 

subpoena copies of the manuals 

accompanying the tests and/or hire 

trial preparation experts in the 

field of vocational evaluation to 

arm the attorney with information 

for attacking weaknesses in the 

vocational evaluation system or 

procedures used. 

The Federal government has 
implemented many laws and 

regulations which are interpreted 
by the courts to insure that the 



rights are not violated. On the 
other hand, Workmen' s Compensat ion 
ancj Insurance agents/attorneys are 
Just as adamant about guarding the 
integrity of their due process for 
disability payments. Thus, when 
ev^auators appear in court for 
expert test imony, they are often 
asked of their vocational 

evaluations, "Pre the instruments 
that you use in conducting your 
vocational evaluation the most 
credible and the most valid on the 
market today? if vocational 
evaluators are to maintain their 
integrity and that of the 
profession, they must oe «uA«r 
respond affirmatively. 

Thio presentation will deal with 
actual cases, Federal laws, and 
interpretations of the 

courts. Example of materials will 
be seen and audience participation 
Will be encouraged. The *ud.^ence 
should leave with a better 
understanding of test ing and 
responsibility as they relate to 
the manufacturer, thi? user, and the 
professional organization. 
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O^UICKTEST 



IT'S QUICK AND E«8Y TO fiDMINISTER 
BUT 18 IT LEQftL? ? ???'???? 



Testing has become an 
integral part in today's counseling 
procsvm. The process utilizes the 
results of tests to help in the 
formulation of a plan for the 
cl ient . Th is 

plan, report , recomrnendat ion, or what 
ever else one wishes to call it can 
alter a person' s life and thus 
there are ground rules established 
by the Federal Government to 
protect the evaluee. These rules 
are called Laws, regulations or 

guidelines which appear in the 
Federal Register, the Code of 
Federal Regulat ions, and oth»r 
publ icat ions. 

Unf ort unat ely they tend to be 
primarily read and acknowledged by 
attorneys and advocate groups 
representing a client's 

interest. The • "head., in the sand" 
syndrome seems to have found some 
disciples in the testing 

community. If I ignore it maybe it 
won' t affect mo. Unfortunately for 
them at torneys are a tev^acious 
group who will seek out those who 
have violated the rigtits of their 
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clients. Th» scales of justice tilt 
in their favor whenever the acts 
are committed ^vhich fly in the face 
of established law. Ignorance of the 
law is no excuse. For lack of a 
better description I will refer to 
t hese "head in the sand " 
individuals as "Easywayers". «n 
Easywayer ie «n individual who 
always looks for the fastest and 
easiest method of testing even if 
it * rnay be in violation of 
established reQul««t ions. The 

Easywayer usually doesn't read the 
manufacturers limitation of use for 
ariouB populations or cautions 



Employment Opportunity Commission, 
fol lowed by several Enecut i ve 
orders and eeOC guideline 

publ icat ions, 1966, 68, 69, 70, 71and 
finally the Uniform Guidelines 
published in 1978. Most of these 
regulacions are published as S9 
U. S. C. a.id 4S U. S. C. These 
guidelines essentially addressed 
the area of employment 

dikcrimin#ition. The 1970 EEOC 

guidelines described discrimination 
aB"The use of any test which 
^^^^r^^^^y affects 
hiring, promot ion, transfer or any 
other employment or membership 



because that^s not the easy way. The 
Easywayer normally will ask a 
marketer of a test these 
quest ions I "How long does it take to 
administer?, how easy is it to 
administer?and not i "how valid is 
it?, how reliable is it?is it 
appropriate for my cliBnts?and most 
importantly does it conform to 
Federal guidelines and not violate 
established law. 

Title vn of the Civil Rights 
Act of 1964 was the first major Pet 
that impacted on the issue of 
ability testing. This act also 
established the EEOC or Equal 



opportunity of classes protected by 
Title VII constitutes 

discrimination 'lessi <a)the test 
has been valid iid and evidences a 
high degree of utility as here in 
after descri bed, and <b) the person 
giving or ac/oing upon the results 
of the particular test can 
demonstrate that alternate suitable 
hiring, transfer or promot ion 

procedures are unavai lable for his 
use". 

In 1971 the Supreme Court's 
opinion in the landmark case of 
Griggs v. Duke Power Co. , 401 U. R. 
424 established that when an 



NATIONAL FORUM 



ABftvasmwnt instrurnent is used in 
the Job »«lection process that xt 
must bm Job ralAtsd.The precedents 

establiBhed by this case have been 
used to substantia ? testing abuse 
or misuse in areas other than 
employment screening. 

Several other «cts such as Title VI 
of the Civil Rights Oct of 
1964, Section 504 of the 

Rehabilitation Ret of 1973 and the 
Education for «lx Handicapped 
Children Ret of 197S (referred to as 
P,L. 94-14S)and implementing 
regulations in Pugust 1977 
addressed most oth-jr areas of teot 

use .One interesting facet of law 
is the ongoing interpretations of 
BHisting law which expand or 
broaden the coverage. Both Section 
504 and P.L. 94-142 contain a 
r«quirement that' handicapped 

persons be provided with" a free 
appropriate public education'*! 
which has been interpreted to 
include evaluation and 

placemert. Sect ion 84. 35 of subpart 
D^'establ ishes placement procedures 
described in the section-by-section 
analysis as "designed to ensure 
that cwi Idren are not 

misclassif ied, unnoces^sari ly labeled 



abi being handicapped or incorrectly 
placed because of inappropriate 
select ion, administrat ion or 
interpretation of evaluation 
materials". Title 45, Subtitle 

R,Part 84-Nondiscriminat ion on the 
Basis of Handica.) in Programs anr" 
Pctivities Receiving and Benefiting 
from Federal Financial 

Pssistance, Federal Register, Vol 

42, 86-WedneBday, May 4,1977. 

84,42 Rdmissions and 

recruitment which states that a 
tesf'Shall assure itself that (1) 
admissions tests are selected and 
admir»istered so as to best ensure 
that when a test is ^^cirninistered to 
an applicant who has a handicap 
that impairs sensory, manual, or 
speaking ski 1 Is, the test results 
accurately reflect that applicant's 
aptitude or achievement level or 
whatever other factor the test 
purports to measure, rather than 
reflecting the applicant's impaired 
sensory, manual or speaking 

skill 5 (except where those skills 
are the factors that the test 
purports to measiure)". 
I arn sure that Ceaser did not say 
this but, "The rules are in place 
, so let the suits begin! " 
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Or, January 3, 1983, the United 
States Court of Appeals found that 
the TVft authority had violated the 
rights of Joseph Stutts,Jr. in 
StuttB V. Fveeft an, 694F. Sd 

666(1983). Mr Stutts was required 
to tai.e the GftTB which includes the 
requirement for reading even though 
he suffered from Dysliaxia. The 
court found"When employer chooses 
tests that discriminate against 
handicapped persons as its sole 
hiring criterion and makes no 
meaningful accommodation for 

handicapped applicant, it violates 
Rehabilitation Ret, "During the 

triaT'Both parties agree tnat Mr. 
Stutts is a handicapped individual 
and that the main hiring criteria 
-the GfiTB test-could not accurately 
reflect Mr. Stutts' abilities". Mr 
Stutts worked for the TVft as a 
laborer and applied in 1979 for an 
apprenticeship training program to 
become a heavy equipment 

operator. "His application was 
denied on the basis of a low score 
on the General Aptitude Test 
Battery (BRTB), a test used by the 
TVP to predict the probability of 
success of an applicant in the 
training program". 



One could hypothesize further 
interpret at ions that would involve 
possible findings of discrirninat iovi 
in testing even to non-handicapped 
people when the test instrument 
incorporates as part of it scoring 
mechanism motions or responses 
tot al ly unrelated to the f »iictor 
being measured which in itself 
could effect the t r ue performance 
of the cl ient. Pnother area of 
potent ial discrirninat ion might 
involve data bases for placement 
which limit the individual clients' 
cho i ces not on their performances 
but by the limitation within the 

data base. Interpretations tend to 
incl ude items or classes not 
explicitly mentioned. 
, ft recent landmark decision involved 
Wat son V. Fort Worth Bank and 
Trust, loss. Ct. £777(1988) . Here 
the Supreme Court held that 
subject ive assessment had the same 
requirement of being "Job Related" 
when used in the selection process 
as object ive . The Griggs case was 
cited "Griggs teaches that 
employment pract ices" fair" in form, 
but discriminatory in operation" 
cannot be tolerated under Title 
VII, 401 U. B. 401 at s31,91 
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S. Ct. at 853. "This lesson should 
not be forgotten simply because the 
"fair form'' « subjective 

one'». Subjective «nd objective 
«Bse«mment must meet the letter of 
the law. 

E«»yw«yer beware, there «re 
concerned parties looking over your 
•houlders The National Center for 
F*ir & Open Test ing (FairTeat ) in 
Cambridge, Mass. is one such group 
which is working with attorneys in 
Washington D. C. to oversee the 
Testing Industry. The process for 
questioning decisions based on test 
results is also in place in many 
states* 

In New York, the LaValle law" is not 
concerned Just with the rights of 
test takers to information about 
the test, it is also intended to 
provide an external spur to quality 
assurance by allowing a test taker 
to Judge the quality of tests used 
to make decisions about his or her 
life, what is required is that a 
test be as advertised and 
sold. ..... Many court actions 

with regard to testing thus far 
have been brought against test 
users for ai leged 

misuse. . • . . the liability for 



duality of tesst lies with the test 
user rather than the test 
producer, for it depends on the 
particular use to which a test is 
put, a test may be valid in one 
circumstance but not in 

another. ". pgaSB, 289, Rbi 1 ity 
Test ing, Uses, Consequornces, and 
Controversies. The Easyway r can't 
keep their head in the sand much 
longer before the courts cover thorn 
ent irely. 

Many people within the testing 
community are sometimes called upon 
as sKpert witnesses. Some of these 
experts fail to use the resources 
that are available . The uninformed 
■Kpert might assume a liability if 
he or she fails . -to keep, up in their 
chosen field and it impacts on 
their client. The law libraries 
hold a wealth of information , and 
ymt experts go into the courtroom 
without researching cases relevant 
to their client. 

Let us look at S5 cases all 
with the same mistake in 
knowledge. 

Blake v. Secretary of Health A 
^^^^^ Services, 5S8 

F. Supp, 881 (1961) 

Weaver v. Secretary of Health & 
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Human Services, 722 F2d310(19B3) 
Wallace v. Secretary of Health & 
Human 

Services, 586, F2dSupp, 395 ( 1 984) 
Ellington v. Secretary of Health ^. 
Human Services, 738 F2d 159(1984) 
and Podeworm v. Harris 

745, 2d210( 1984) where in each case 
the expert witness listed aptitudes 
as a transferable skill even though 
the courts h&d given a decision on 
thrs in the earlier 1981 
case, "skill is acquired and 
relates to doing a specific act , and 
isn't the same as an "aptitude" 
which involves only basic work 

activities, necessary to do most 
jobs". Biake v. Secretary of 
Health & Human services. 328 
F. Supp881 (1981 ) - 

It's time that the test 
producers, users and. takers become 
more aware of the exist ing laws to 
protect their interests. PESCO 
International recognises it's 
obligation and has pv^epared this 
material to be of service to the 
test ing communi ty. 

We accept the responsibility 
that comes with the design of our 
systems and realize the importance 
of " Accuracy ", Compute-ft-Match 



^^^^^ consists of 

S. «• E,J. 0. B. S. ,and 
fiUT0^3C0RE will never be modified 
Just to fit a "TIME FRRME". Time 
should be used for the benefit of 
the Counseling Process and not to 
the detriment of it. Voice your 
concerns to PESCO Int ernat ioi .al and 
we will listen. You are not a 
percentage in sales, but 

professional with views we respect 
and value. 
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Abstract 

The purpose of this paper is to present an overview of 
current and emerging ethical and professional issues in 
vocational evaluation. The paper will begin with a review of 
the VEWAA Code of Ethics (i.e., responsibility, 
professional competence, confidentiality, interprofessional 
relationships, publications, and consultation). In addition, 
s|)ecific ethical dilemmas will be examined that arc related to 
work disincentives, the use of psychological tests, program 
evaluation length, and the role of the client/consumer in the 
evaluation process. The paper will conclude with a 
discussion of the need to establish more definitive guidelines 
for determining ethical behavior in vocational evaluation. 
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In order for a society to work, individual members 
must be willing to adhere to specific rules which regulate the 
actions of the group. According to the late singer, Jim 
Croce, the rules for a certain pool room on 42nd Street were 
to avoid the following situations; (a) sitting on Superman's 
cape, (b) spitting into the wind, (c) removing the Lone 
Ranger's mask, and (d) messing with someone named Jim. 
Unfortunately, most societal rules are not that simplistic and 
direct, instead they are vague and subject to numerous and 
varied interpretations. For instance, when we were young 
our parents admonished us to not lie, but as we got older and 
became more sophisticated with the ways of society, we 
learned that it was OK to tell lies if in doing so we avoided 
hurting another person's feelings. 

Over the yeai*s we have have also been taught, 
among other things, to avoid doing harm, to give assistance 
when possible, and to respect the rights of others. We know 
that we are expected to respect and adhere to the edicts, laws 
and mandates of our government. Our parents and other 
relatives have instilled certain values, tenets, and beliefs in 
us. Finally our neighbors, friends, employers, co-workers 
and other associates impact on the rules that govern our 
behavior. Wccan even learn su|)Ci*stitious beliefs from the 
two year old next door who admonishes us to avoid stepping 
on cracks lest we break our mothers' backs. In other words, 
our behavior is being regulated at all times, either 
consciously or unconsciously, by the specific rules, laws, 
mandates, tenets, edicts, and values which enable us to 
determine if our actions are ethically and morally connect. 

Kitchener (1984) classifies moral thinking into two 
levels: (a) intuitive thinking which relies on past teachings 
and is partially composed of the "oughts" and "ought nots" 
we were taught as children, and (b) critical-evaluative 
thinking which involves the act of making judgemems based 
on reason and evaluation. Intuitive decisions are made 
instinctively, while critical-evaluative decisions involve 
much thought before a judgement is made. Professional 
organizations establish Codes of Ethics to provide members 
with intuitive rules, also known as the "oughts" and "ought- 
nots". Most Codes of Ethics, however, are so vaguely 
written that interpietation requires much critical-evaluative 
thought. Unfortunately for the practitioner faced with an 
ethical dilemma which must be resolved immediately, little 
assistance can be found in these vaguely written guidelines. 
Codes of ethics were developed by several professional 
rehabilitation associations between the years of 1970 and 
1981 (Cottone, Simmons, & Wilfley, 1983). The 
establishment of such codes V\'as an essential component of 
attaining professiofial status for various disciplines within 
the generic field of rehabilitation. The term "ethics" is 
usually thought of as a way of discerning not only what is 
good and bad, but also moral duty and obligation. Both 
Nadolsky (1986) and Stude and McKelvey (1979) allude to 
the ix)wer of the ethical standards of a discipline or 
profession to regulate member's behavior. 

According to Kitchener (1984) there are thi'ee 
reasons which explain the importance of ethical codes of 
conduct: (m) the promol^^n of professional loyalty and trust 
, (b) the provision of standards by which one actions can be 
justified as morally coirect, and (c) the establishment of 
disciplinary actions for members who do not adhere to the 
rules of the group. It sliould be noted, however, thai 
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Kilchcncr (1984) iilso ivporls liial "ciiii<.:il codes arc 
Ircquenlly more proicciivc of the pvofcssioii itself llian of ihe 
consumer and omit many issues of ethical concern" (p. 45). 
The Vocational Evaluation and Work Adjustment 
Association (VEWAA) and the Commission for the 
Certification of Work Adjustment and Vocational Evaluation 
Specialists (CCWAVES) are the organizations responsible 
for creating the code of ethics and certification procedures, 
respectively, for vocational evaluators and work adjustment 
specialists. VEWAA and CCWAVES are separate 
organizations, however, both recently began examining the 
ethical codes and standards of behavior established by the 
respective organizations. One result of these reviews has 
been a commitment to the revision of the ethical standards of 
both organizations. 

The Vocational Evaluation and Work Adjustment 
Association was incorporated in 1972. Within tiie Articles 
of Incoiporation is a statement addressing tiie need for 
"promoting the highest ethical practices in vocational 
evaluation and work adjustment training of the handicapped" 
(Articles of Incorporation, VEWAA, 1978, p. 7). The 
Vocational Evaluation and Work Adjustment Association's 
Code of Ethics was adopted in 1970 (Cottone, Simmons, & 
Wilflcy, 1983). Adherence to this code is required of all 
VEWAA members. The six areas of concern which are 
addressed in this document are: responsibility, professional 
competence, confidentiality, interprofessional relationships, 
publications, ar\d consultation. Responsibility charges the 
evaluator with the task of being primarily accountable to the. 
client being served, with the expectation and encouragement 
of ethical and competent behavior to other vocational 
evaluators, and with the responsibility of reporting unethical 
behavior to the proper authorities within VEWAA. 
Pr(;^fessional competence requires practitioners to have 
gained through educational and vocational experiences the 
competencies needed to fulfill the requirements of vocational 
evaluation, to be capable of understanding and interpreting 
acquired information to clients, to possess an working 
knowledge of the world of work, and to be familiar with 
human behavior studies. Co nfidentiality insures privacy to 
individuals receiving vocational evaluation services. Only 
|)ersons named in a written format by the client receiving 
services are to be given access to information concerning the 
client. Client information stripped of identifying information 
can be used for the puiposes of training students conducting 
research, or writing, but only if consent is granted by the 
client. Interprofessional relationships guarantee that the 
vocational evaluator is awaie of the valuable assistance 
provided by other professionals. The primary concern 
focuses upon the client and frequently a van ty of programs 
provided by a variety of agencies is needed i order to 
provide comprehensive services. Evaluators are to be aware 
of individual limitations, and not profess expertise in 
unfamiliar areas. Through the act of publishing ^ valuable 
information is transmitted to other practitioners and is 
assimilated into the existing fund of knowledge of the 
profession. The provision of c^cysultation seirices is 
granted to vocational evaluators, but only in areas of 
acknowledged expertise. Knowledge gained in private 
ventures is also subject to confidentiality restrictions. 

Even though a professional code of ethics has been 
established by VEWAA and each member is provided with a 
copy of the Code, this topic continues to be of such concern 
to practitioners of this professional organization. A survey 
of the membership of the Illinois Vocational Evaluation and 
Work Acljuslmciil AsscK-iulion (IVIiWAA) in 1987 revealed 
a demand for information concerning ethical conduct 
expected of vocational evaluators and work adjustment 
spec ialists. One of ihc reasons cited for Ihis continuing 
demand concerns ihe belief that an erlablishcd code of ethics 



is more ihaii a stl of principles und<;r which professionals 
ojxirate on a daily basis. "A code of ethics goes beyond the 
mind and body of a discipline (i.e., its knowledge base and 
techniques), and atiempis to provide a cun.science for the ^ 
discipline and its practitioners by focusing on the discipline's 
underlying purpose" (Nadolsky, 1986, p. 7). Another 
reason, cited in requests for training sessions dealing with 
ethical issues, is the lack of published information 
concerning the topic. "Because ethical codes may be too 
broad in some cases and too narrow in others, etiiical 
principles both provide a more consistent framework within 
which cases may be considered and constitute a rationale for 
the choice of items in the code itself" (Kitchener, 1984, p. 
46). 

During their research of articles addressing ethical 
topics in the fields of vocational evaluation and work 
adjustment, Cottone, Simmons and Wilfley (1983) found 
numerous articles on the need to establish a code of ethics, 
but very few addressing specific ethical dilemmas. The 
topics that have been addressed in vocational evaluation 
concern such areas as assessment instruments and 
techniques (Matkin, 1980), program length (Wahl, 1983). 
use of quotas (Mades, 1986), and the need to examine 
specific ethical dilemmas (Early, 1987). A final reason 
filiates to the future of human service professions, v h as 
vocational evaluation and work adjustment. Practitioners, 
especially trainers, are obligated to indoctrinate students and 
interns to the concepts of ethical behavior as practiced by the 
profession. Specifically, persons "who are involved in 
training have as strong an obligation to train students in the 
potentials for harm that may result from assessment and 
diagnosis as they do to (rain students in the appropriate use 
of these same instruments and labels" (Kitchener, 1984, p. 
49). 

The issues of etiiical bciiavior and competence are 
mentioned several times in the VEWAA Code of Ethics. The 
advent of CCWAVES and the certification process for 
vocational evaluation and work adju.stment specialists have 
established guidelines indicating minimum competencies for 
pracdtioners in both fields. However, the term "ethical 
behavior" has not been defined in such a manner by cither 
group. At liie present, liic act of defining the term lias been 
primarily left up to the individual practitioner. In other 
. words, each individual practitioner has to develop his or her 
own set of standards. This practice would be adequate if all 
persons had identical value systems, but, since this is not the 
case, solutions to ethical dilemmas are presently personalized 
and reflect the ideology of the person making the decision. 
Nadolsky alluded to this fact in an editorial published in 
1986 with the statement, "although all members of a 
professional rehabilitation organization are expected to 
ascribe to the organization's Code of Ethics, many members 
engage in "professional" activities that seem to be derived 
more so from a set of personal standards (which are 
external to the purpose of their discipline) than from the 
discipline's code of ethics" (Nadolsky, 1986, p. 7). 

According to Rubin and Roessler (1986) "ethical 
dilemmas exist when strong moral reusons can be provided 
to support very different conclus'ons in regard to the 
selection of the most appropriate action" (p. 11). Arguments 
can simultaneously be made both for and against an issue. 
Sources of ethical dilemmas can be found almost any where 
at anytime. There are four major sources of ethical dilemmas 
for vocational evaluators: (a) the vocational evaluator's 
responsibility to the clients, consumers, ^.ducators, and 
family members, (b) tlie V(K*alional evaluator's respoiisihilitv 
to the facility management, supcrvisoi-s, (c) th^ vocational 
evaluator's responsibility lo the community at large including 
employers, the profession of vocational evaluation, and tax 
payers, and (d) the vocalional evaluator's rcspnsibilily lo 
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llic rcl'ciral source whteli ciiii include sUUc iigcncics, 
insmance carriers or service/bill payers. One illustration of 
an ethical dilemma within an education setting would revolve 
around the duiy of educators (trainei-s) to not only instill in 
students the proper way to perform certain duties, but also to 
teach the ethical manner in which these duties are to be 
completed. Another example that is moi*c general would be 
finding money on the street. Most persons would not feel 
uncomfortable keeping a $100 bill found on a street corner; 
however, they may possibly have problems justifying to 
themselves keeping the money if it is found in a wallet. 
Furthermore, if the wallet hapixjns to contain identification 
of its owner, the finder may realize even morecf an impetus 
to return the wallet intact to its rightful owner. Another 
illustration of this point concer*»o rescuing persons from a 
burning building. Most persons would not require much 
though about rushing into a burning building if a child could 
be safely rescued by doing so^ However, most persons 
would probably hesitate if it was Ted Bundy who was inside 
the building and needing rescue. These illusaations prove 
that ethical decisionma'<ing is not an easy task and it will be 
necessary to explore ethical dilemmas commonly 
experienced by vocational evaluators through an individual 
case by case» person by person approach. According to 
Kitchener (1984) there are five guiding principals to use 
when resolving ethical dilemmaj* (a) autonomy or making 
one's own decisions and respecting the autonomy of others 
(i.e., privacy rights, informed consent), (b) fidelity or 
loyalty being faithful, and keeping promises (i.e., voluntary 
relationships, trust, confidentiality, contractual obligations), 

(c) justice or treating everyone equally if they are equals and 
treating unequals differently if the inequity is relevant lo the 
problem (i.e., ability to pay, equality of merit or effort), 

(d) nonmaleficence or avoiding causing harm (either 
intentional or potential) to others (i.e., research, misusing 
tests, justifiable discomfort from treatment or medication, 
labelling), and (e) beneficiencc or doing good for others 
(i.e., paternalism, right lo chose to not participate, balancing 
harm with good). 

It is hoped that this paper might serve to generate 
further discussion of the topic of ethical behavior in 
vocational evaluation and work adjustment settings, and 
ultimately lead to the establishment of guidelines outlining 
ethical standards for students, educators and practitioners in 
the areas of vocational evaluation and work adjustmep.t. 
Ethical issues related lo client disincentives, financial or 
budgetary disincentives, conflicts of interest, test 
modifications, lest puq^oses, using the same test to assess all 
clients, ti-aining, and quotas and program length will be 
discussed in the following sections. 

Client D i sincentives 

One example of an ethical dilemma which vocational 
evaluators often face is described in the following scenario. 
A client is referred for vocational evaluation services in order 
to determine feasible vocational goals and objectives. The 
individual is man'ied and has two children ages 2 and 4. The 
four year old, bom with a defective heart, has required 
numerous hospitalizations in the past, and will continue to 
receive close medical monitoring in the future. While on a 
family vacation one year, the client fell off a truck and 
.suffered a closed head injury which is manifested by 
occasional severe mocKl swings. After the injury, 
employment wiis terminated and the client has not worked in 
the last five years. The wife does not work outside the home 
because of the family's religious beliefs, Total income for 
the family amounts to a monthly check from Social Security 
of $575.00, including Medicaid coverage. The individtial 
quit school after the eighth grade in order to help support his 



laiiiily. A recent iitlininislrahun of the Wechsler Adult 
Inielligence Scale-Revised rendered a full scale intelligence 
quotient of 86. Feasible employment options are determined 
for this client, however, the starting salary for any job will 
be minimum wage. Therefore, if the client finds and accepts 
employment, not only would the family's monthly income 
drop, but the Medicaid coverage would be lost. The 
monthly premium for medical coverage for a family of four 
is approximately $120.00 per month, Disincentives 
resulting in a reluctance to return to work include the loss of 
cash benefits, benefits in kind, Medicare/Medicaid, or 
eligibility for particular service programs. ''However, these 
benefits will not be lost if the client simply attains a higher 
degree of independent living skills ' (Berkowitz, 19£0, p. 
42). 

In a situation such as the one described above what 
should an evaluator do? Should he or she recommend the 
identified employment options, knowing full well that the 
family would suffer financially from the consequences of 
such a decision? Would it be ethical to advise the man to 
stay on Social Security and, thus, at least maintain the 
minimal financial security now enjoyed by the family? 
AccoitJing to the definition provided by the Tenth Institute 
on Rehabilitation Services (1972) the purpose of vocational 
evaluation is to provide vocational development assistance to 
individual clients. Would an evaluator who advised the 
client to remain on Social Security be violating the VEWAA 
Code of Ethics? The Code states that the individual client 
being served is the primary focus of vocational evaluation. 
By addressing the total client needs, the individual described 
above would suffer hardship if he became employed. 
Would an evaluator be remiss in recommending non- 
vocational goals? 

Financial or Budgetary D isincentives 

The 1986 Amendments lo the 1973 Rehabilitation 
Act mandate that rehabilitation agencies serve persons with 
sevei*e disabihties* Although funding for such programs has 
increased over the years, the actual number of dollars allotted 
to serving i^rsons with severe disabilities remains far below 
what is actually needed by service providers. Furthermore, 
this inadequate funding situation has also resulted in low, 
non-competitive salaries, and has forced rehabilitation 
agencies to consider and employ persons of less skill and 
education to fill staff positions. 

School systems must directly or indirectly provide 
appropriate educational services lo all children as mandated 
by the Education for All Handicapped Children Act (Public 
Law 94^142) (Langan, 1988). This law does not address 
how the money for such programs is to be appropriated and 
assumes that adequate lax bases exist for the addition of 
these specialized services. In addition, PL 94-142 addresses 
neither the fact that possibly few persons within any given 
school system will require a specific service nor the 
availability of qualified service providers within a school 
district. In other words, vocational evaluators working 
within school systems, as well as rehabilitation facilities, 
will have to balance student/client needs with the budgetary 
limits of the school or facility. 

Conflicts of Interest 

Lawyers, psychologists, doctors, educators, and 
riher prolessionals cite that their primary rcs|>onsibility if to 
;heir clients, patient.., students, in other words, the 
consumers of their services. Although not publicly 
admitted, these professionals are also obligated lo serve the 
wishes of the administrators of their law firms, clinics, 
hospitals, schools, or place of employment. The balancing 
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')! rcspniisibiiily In holli cliciil ;uk1 place iil" cmpluyincMl c.in 
only be resolved by going into private practice and in elTect 
becoming one's own boss. 

The Ethics Committee of the Vocational Evahiation 
and Work Adjustment Association has developed a Conflict 
of Interest statement for the leaders of the organization. 
However, the assignment of primary responsibility to either 
client or place of employment remains a personal decision 
for vocational evaluators at this time. 

Test Modifications 

The example above is one that evaluators may or may 
not have to deal with during their careers but there aie other 
ethical dilemmas which are faced by vocational evaluators on 
a daily basis, Students of evaluation recwe classroom 
instruction and practical experience in evaluation planning, 
test selection, administration, and interpretation, and are 
taught to always follow the standardized directions in totality 
and to never utilize a test instrument for anything other than 
its original intent. In practice, it would be extremely 
tempting to ignore some of ine standardized instructions 
especially when working with several clients doing different 
things at one time. It is common knowledge that non- 
adherence to the published format can seriously affect not 
only the outcome of the test but also the ability to relate 
scores to the standardized norms provided in the manual. 
However, when faced with several clients who are all 
demanding something to do at one time, the shortening of 
lengthy and detailed instructions would enable the evaluator 
to more quickly meet the individual demands of each client. 
It is also possible that some clients will not sit through all the 
instructions and will begin to look through the actual test 
materials. Adherence to standardized procedure may only 
serve to frustrate some clients which in turn could negatively 
affect their test scores. Improvising test instructions could 
also be a temptation when the evaluator is interrupted during 
an intense counseling session or is conducting behavioral 
observations on another client. What should evaluators do 
in situations such as those listed above? Would it be ethical 
to alter the standardized directions on such things as 
completing the information requested at the top of the 
scoring sheet, such as school, teacher, l^t grade attended, 
etc.? Art there cases when it is ethical to revise test 
instructions? In addition, if strict adliercnce to the belief that 
administering a test in any way that deviates from the 
standardized format is unethical, then can non-standaidizcd 
test modifications be justified? Is it ethical to read a test to 
clients who are visually impaired or otherwise unable to read 
it for themselves? Is it the ethical duty of evaluators to 
administer timed examinations to persons who are unable to 
write quickly? Is the practice of using written instructions 
with persons who have auditory memory problems 
unethical? Is it wrong to convert tests into larger print for 
those with visual impairments? Non-improvisation of test 
directions is somethmg which cannot possibly be regulated, 
therefore it must be the ethical responsibility of each 
individual vocational evaluator to follo^ / this practice. APA 
standards require practitioners to cither follow standardized 
procedures or to consider the test results invalid; however, 
the American Psychological Association's position is 
frequently ignored in vocational evaluation, primarily due to 
the overall goal of vocational rehabilitation • /hich is to 
inaxinii/.c |xHcnlial of clicnis. Malkin (198u) has pointed out 
that although vocational evaluators need to be knowledgeable 
about assessment devices, "liiilc in the way of spcciHc 
inlbrmation is provided the professional in the area of clhical 
usage of the very tools of his/her trade, i.e., assessment 
instruments and techniques" (p. 57). 



Students are also taught that the eihical vocational 
evaluator should use a test for its intended purjx^se only. 
The reason for this rule can be found in numerous court 
cases addressing illegal hiring, personnel selection biases, 
and/or promoting practices of some employers (Matkin, 
1980). However, is it alv/ays unethical to utilize a test for 
another purpose? For example, some work samples could 
be used (without recording or reporting norms) as simulated 
work stations to answer questions concerning client 
frustration level, interest, ability lo concentrate for long 
periods of time, and physical stamina. Directions for several 
tasks could be chained together in order to determine a 
client's ability to remember and follow multiple step 
instructions. On-the-job evaluations (OJEs) or placement at 
a work station within a sheltered facility are the usual 
methods of obtaining work behavior observations, but in 
either situation the evaluator not only loses the ability to 
control the environment, but also must frequently depend 
upon others for behavior observations. In lieu of an OJE or 
workshop placement, u situational assessment could be 
completed provided that the evaluation room is capable of 
serving as a work room in addition to a testing room, and 
that enough raw materials can be brought into the area. 
However if the above options are not available, would it be 
ethical lo use work samples in the manner described above to 
obtain the needed infomation? 

Using t.ie Sa me Te^^t to Assess all Clients 

Paper and pencil psychological tests are the least 
costly and least time consuming tools of vocational 
evaluation, therefore another ethical conflict within the field 
of vocational evaluation involves the u.se and overuse of 
testing. There is also a tendency in small evaluation units 
with limited financial resources to purchase an assortment of 
assessment tools and expect evaluators to administer all tests 
to every client. This battery is usually either one of the 
commercially available evaluation systems, or includes a 
brief academic assessment, an interest inventory, several 
dexterity tests and, possibly, a personality inventory. Many 
test and work sample companies go to great lengths to 
provide data proving that their product is suitable for use 
with various populations and provide statistical data in the 
test manual and promotional materials which confirm their 
assertions. However, provided the evaluator has the time 
and knowledge to do so, a closer examination of these 
l^ublications may reveal inconsistencies between the actual 
data reported in the test manual and the subsequent 
interpretation of this data by the test author or publisher. 
One test does not fit all clients. In order to effectively assess 
individual clients, a variety of instrumenJs must be available 
for evaluator use. The use of a variety of assessment 
measures meeting individual needs is another principle that is 
stressed to vocational evaluation students. But not only is 
the possibility of having only a few instruments available for 
use rarely discussed, guidance as to what an evaluator could 
do when confronted with this situation is also not provided. 

Training 

The use of a commercial .system brings up another 
ethical dilemma for i he practicing vocational evaluator. 
Several of these commercial systems require specific training 
prior 10 purchasing and using the system. What should 
beginning evaluators, who have not received this training, 
do when told to use the system? Should they insist on 
obtaining the training, or should they just plunge in and leani 
the system by trial and error, hoping that they make no major 
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mistakes in achninisiriiiion, scoring, and/or inlciprclalion? 
The potential for errors on client results is increased when 
non-trained practitioners use assessment instruments which 
require sixjcialized training. 

A second dilemma within this area has been 
developed with the advent of CCWAVES and the 
certification process. At the present, CCWAVES requires 
applicants for certification to have attained at least a Master's 
degree. However, most rehabilitation facilities employing 
vocational evaluators require applicants to have a Bachelor's 
degree and some only require a high school diploma. The 
question becomes one of adequate representation. In other 
words, is the certifying body actually representing the 
majority of practitioners? Furthermore, does the certifying 
body wish to represent the majority of practicing vocational 
evaluators? Do non-certified vocational evaluators have a 
right to practice their profession? Should certific^ition be 
mandated? 

Quotas and Program Length 

Matkin's (1980) warning that vocational evaluatoi-s 
be alert for the development of dei>endency upon assessment 
tools to provide the total picture of an individual's vocational 
assets and limitations ties in with two other ethical dilemmas 
that evaluators face on a daily basis: the use of quotas and 
program length. Performance appraisals (during annual 
salary and promotion reviews) are difficult for supervisors 
of vocational evaluators because of the subjective nature of 
the work. Often the only objective measure of performance 
is the number of clients served during a year. The problem 
with using a quantilalive measure such as number of clients 
served is that, in the quest to serve a predetermined number 
of clients, it may become necessary for an evaluator to 
forego quality of service in order to obtain the needed quota 
of clients served. It is possible that the client can become 
more important as a statistic than as a person requiring 
assistance in determininr, a vocational goal When quantity 
becomes more important than quality, dependency upon 
certain assessment instruments becomes apparent. 
Developers of tests, especially batteries and systems, 
augment the problem by insisting that their instrument can 
meet the needs of most clients. Again, we've come to the 
common practice of "one test fits all". Adherence to this 
philosophy can be related not only to the goal of providing 
services to a larger number of clients, but also to the 
administrative demand that service delivery to clients be 
completed in less time. In these days of shrinking budgets, 
balancing the needs of the facility with those of individual 
clients is an extremely difficult and delicate task. Mades 
(1986) offers one solution to the problem by asserting that 
governmental bodies should be approached with data 
showing how a reduction in quotas could be equated with 
improvement in the quality of service delivery for all clients. 
Wahl (1983) suggests that although lengthier evaluations 
may be more costly at the onset of services to an individual 
"if it produces a more positi /e, more substantial result, and 
leads to full rehabilitation ci'thc client, the cost in the long 
run may prove to be less" (p. 83). However, results from a 
recent study suggest that expressed client satisfaction may 
decrease as a function of the length of time spent in a 
vocational evaluation program (Early & Bordieri, 1988). 

^mmm 

Society is conslanlly changing. As the profession of 
vocational evaluation strives to meet the changing needs of 
our clientele, the old solutions and techniques become 
obsolete. Some other ethical service delivery dilemmas not 
addressed in this paper include the topics of client 
confidentiality and the temptation for practitioners to project 



Iheir |x:rsoMal value hierarchy onlo ihe client. In any elhiral 
dilemma, the question of what course of action should be 
taken by the individual cvalualor is extremely important. 
The term "ethical behavior", alluded to so frequently in the 
literature, needs to be more closely defined. Arras and Hunt 
(1983), however, warn that defining ethical behavior will 
not be an easy task. "Many see nil ethical questions as 
relative to the attitudes and customs of the particular society 
in which they arise; that is, they believe that the Tightness or 
wrongness of an action or practice cannot be determined 
apart from the cultural or societal context in which the action 
occurs" (Arras & Hunt, 1983, p. 6). 

Ethical codes foimed by professional organizations 
serve to govern the conduct of its membership and thereby 
fulfill one of the reasons advocated by Kitchener (1981) for 
having ethical codes of conduct which is promotion of 
professional loyalty and trust. Since most ethical codes, 
however, provide little in the way of specificity of behavior 
and arc not enforceable. Kitchener's (1981) second reason 
which illustrates the imix>rtance of ethical codes, the 
provision of standards of acceptable behavior, remains 
unfulfilled. Kitchener's (1981) third reason, establishment 
of disiplinary actions has been attained by professional 
organizations such as the American Psychological 
Association and the American Medical Association. Both 
formal and informal disciplinary tactics are used to police 
members of professional organizations with established 
codes of ethics (Stude &McKelvey, 1979). While informal 
discipline is usually in the form of subtle pressure and 
discussions among professionals, f9rmal discipline usually 
involves public censure, sanctions, or removal of credentials 
(either permanently or temporarily). As noted previously, 
several authors have alluded to the power of an 
organization's ethical code to police the professional conduct 
of its members (Nadolsky, 1986; Stude & McKelvey, 
1979), however disciplinary measures for violalers of the 
VEWAA Code of Ethics remain unaddressed at the present 
time. 

The VEWAA Code of Ethics can not be vicwec an 
all encompassing document (Nadolsky, 1986). The current 
VEWAA Code of Ethics addi*esses general philosophical 
principles but not specific issues or situations. The Ethics 
Committee establisned by VEWAA should not only provide 
assistance to members seeking answers to ethical dilemmas, 
but also review and, if necessary, revise the Code in order to 
ensure that professional guidance concerning ethical 
behavior is provided by the Association. A casebook, 
similar to those established by the American Medical 
Association and American Psychological Association, 
outlining ethical uiicmmas and scenarios combined with 
interpretations of the situations and rulings on ethical 
behavior would prove extremely helpful not only to students 
of vocational evaluation, but also to educators and current 
practitioners. The sharing of solutions to ethical dilemmas 
through the professional publications such as the VEWAA 
Newsletter and Bulletin should be encouraged. It may al.so 
be advantageous for the Code as well as case studies and 
rulings to be published in the VEWAA Bulletin on a ycariy 
basis. 

Both the leadership and membership of the 
Vocational Evaluation and Work Adjustment Association 
have begun to fimher addrcs.s the ethical dilemmas faced by 
practitioners. A committee has been recently formed to 
initially consider the adoption of a conflict of interest 
statement and to eventually examine the cun^nt VEWAA 
ethical codes and formulate a casebook suggesting possible 
solutions to ethical dilemmas faced by vocational evaluators. 
Guidelines defining ethical behavior would not only enhance 
the professionalism of current practitioners, but also provide 
a framework for future generations of vocational evaluators 
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and work udjuslmcnl specialists. Tlic suggested casebook ol' 
ethical dilemmas and case ruMngs will serve as a basis fo»* 
reinforcing ethical principles among practicing vocational 
evaluators and work adjustment specialists. As noted by 
Wahl (1983), '*the achievement of certification for evaluation 
and adjustment specialists is a sign of growth for the 
profession which is accompanied by added i*esponsibility for 
continuing concern that the professional engage in the most 
effective and most ethical practice of their profession" (p. 
84). 



Tenth Institute on Rehabililation Services (1972). 

Vocational evaluation and work a diustmcnt services in 
vocaliona) rehabilitation . Mcnomonie, WI: Materials 
Development Center, Department of Rehabilitation & 
Manpower Services, University of Wisconsin-Stout. 

Wahl. K. (1983). Vocational evaluation program length: An 
ethical issue. Vocational Evaluation and Work 
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Abstract 

Vocatiunal Assessm-.it and Evaluation as 
a profession has expanded to a variety 
of discip'^^nes in recent years. It is 
currently utilized in many settings and 
with varying populations. A myriad of 
professional groups presently exist 
whose members include individuals 
responsible for provi^-^Mg vocational 
assessment and evaluation services . 
Creating a mechanism for consistency of 
effort to clarify common areas of need, 
and to establish professional standards 
and • guidelines would strengthen the 
field and enhance our profession's 
effectiveness. 

At the grass roots level, strategie© are 
needed for mobilization of effort to 
address legislative attempts to 
eliminate or alter existing oorvices. 
Unification of allied professional 
groups would result in a stronger 
lobbying presence. Recent legislation 
calls for assessment services and 
resultant programs need a sense of 
cohesivem-ss and direction so they might 
effectively utilize qualified providers 
and offer quality services in a 
responsible manner. At present, 
programs may be under-u;;ili2od as a 
result of fragmentation. 

It is our belief that a nationally-based 
advisory group should' be established to 
allow ::or communication, consistency, 
and effective collaborative strength. A 
^global' outlook ehould be the basis for 
allied ptcfesoionals to come together 
and examine the universal implicationo 
of programs, legislation, and training 
of providers. A system of advocacy, 
from the grass-roots to the national 
level, needs to be detailed, so that 
individuals and organizations may be 
suppor\:ed in their lobbying, training, 
and programming efforts. The focus of 
this paper will be to present a model 
for a national advisory group, ident- 
ifying several key organizations, and 
suggesting issues which should be 
addressed. 
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The time has come for practitioner© 
in the field of vocational evaluation 
and asBeesment to effectively shape 
policies and events that define our 
profession. We cannot be content with 
the delayed response of reacting to 
existing policy. Literature reviews 
suggest a 'weak presence' of the 
essential elements necessary for 
establishing a more proactive stance. 
These elements include professional/name 
recognition , practitioner advocacy , 
legislativs presence , collaborative 
relationships among representative 
specializations, and published research 
to substantiate professional effective- 
nesB as well as provide a bae/.s for 
account^evbility and consistency • 

In examining other well-established 
professions, such as law and medicine, 
it is apparent that an organizational 
structure is in place that provides a 
system of communication (both internally 
and externally), consistency in 
practice, and effective collaborative 
strength. Medical practitioners have the 
American Medical Association, and legal 
practitioners have the American Bar 
Association. Theee two organizations 
embrace the many smaller sets, subsets, 
divisions, etc., which represent the 
concerns of Individual specializations 
within the broader, more universal 
issues of mutual concern. By taking 
stock of our current positions, 
practitioners in vocational evaluation 
and assessment might identify common 
strengths upon which we can capitalize. 
Utilizing existing organizational 
structures such as those provided by the 
AMA and ABA, _an_ effective model cgjild be 
developed for the profession of 
vocational evaluation/assessment. Toward 
this end, we will review the concepts 
and issues of professionalism^ advocacy 
and affiliation, as well es identify 
appropriate organizational participants 
and some of the advocacy issues that 
might be addressed by this association. 

Why do Vocational Evaluators strive 
for professional status? In recent 
years the goal of establishing the 
professionalism of evaluation has been a 
central focus of both discussion and 
writing, The need for "community 
sanction" suggested by Horace Sawyer at 
the 1987 VEWAA forum is but one aspect 
of thie goal, albeit one of the more 
traditionally Identified reasone. In 



the current world of evaluation and 
assessment, perhaps the answer to why is 
ingrained not in the benefits of bein^^ 
viewed as a professional by the external 
world, but in the internal risks of 
being anything other than professional. 
These risks transcend issues of salary, 
recognition, or respect, to reach the 
core of that which defines 
' professional ' . 

The "ideal" or "paradigm profes- 
sionals", doctors, lawyers, and members 
of clergy (Mnline 1986) are identified 
in part by their education, 
certification requirements and 

dedication to their calling. Beyond this 
however, they are professionals in the 
"honorific sense" (Moline, 1986) and are 
individuals with whom "fiduciary" 
relationships are established. This, 
according to Moline, is the element that 
truly defines a professional as separate 
from the myriad of employed persons who 
have attached 'professional' to their 
occupational title. In quoting Black's 
Law Dictionary, Moline characterizes the 
"paradigm professional" as "believing 
themselves bound to act in equity, good 
conscience, and good faith, with due 
regard to the interests of the one 
reposing the confidence". This, then, 
is the source of our motivation to 
achieve professional status ; the 
abatement of misdirection of those who 
enter into this fiduciary relationship 
for the purpose of discovering their 
vocational potential. For as we view 
the present trend of insufficient monies 
for evaluation/aseeesment training 
programs, the influx of non-evaluation 
practitioners into the field, the spread 
of invalid and incomplete assessment 
data due to lack of knowledge, and the 
marketing of technical equipment to the 
layman, we know the risks are too great 
if we turn aside from cur goal. 

The basic elements necessary for 
achieving professional status have been 
thoroughly identified by McDaniel , 
Sawyer, and others (1987). Vocational 
evaluation has currently established 
"definable territory, several 

professional organisations, a certifying 
process, university education as a 
prerequisite to entry, and a developing 
body of knowledge" (McDaniel, 1987). 
Despite thie, however, the 

"fragmentation within the field of 
rehabilitation" and "competition for 
professional service territory"- (Sawyer, 
1987) creates an impediment to progreso. 
Whon Mr. MoDaniel randomly assigned the 
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1987 forum attendees into groups and 
asked them to identify the central 
issues facing evaluators in achieving 
professional otatuo, this theme of a 
need for "one professional voice" 
(Sawyer, 1987) ran through each group's 
recommendations. Whether phrased as a 
requirement to "define our 

commona) ities" or establish "more 
standardization in our practice", the 
urgency for "a centralized organization" 
was evident . 

Advocacy Iflsues in Vocational Eval- 
uation/Aaflaaomflyit 

According to Webster's New World 
Dictionary, to advocate means to plead 
another's cause, to apeak or write in 
support of something. Essentially, this 
is a position each of us takes as a 
natural part of our Jobs. We advocate 
for our client/student, assessment 
position, ancillary eervices and 
sometimes a promotion. 

* As vocational evaluators, often we 
are placed in positions to both define 
our profession and educate our consumer. 
Many evaluators seek membership in a 
variety of professional associations, 
not only to remain abreast of state- 
of-the-art practices in related fields, 
but to develop collaborative 
relationships which can focter linkages 
and yield support when needed. This 
seems like an all-consuming Job, but a 
necessary entity to maintain our 
professional status quo. 

While advocacy efforts are 
important at the "grassroots" level, it 
is equally important for evaluators to 
voice their concerns at the local, 
state, regional, and national level. 
Policy, implementation and certification 
issues abound and require the expert 
guidance of those most familiar with the 
service - the practitioners. We can no 
longer rely on those few dedicated 
individuals who represent us on 
committees, certification boards, and 
congressional hearings to be the sole 
conveyor of concerns and issues. 

Now, more than ever in the history 
of our profession, we face the challenge 
of defining our existence. Administra- 
tors seek ways to offer assessment 
services in shorter periods for a more 
cost-effective method. At times, even 
the evaluator is an unknown commodity, 
as "other professionals" have determined 
that they too can provide the same 
service. 

On a federal level, policy makers 
eeem unaware of the importance o: 
vocational evaluation and have 
difficulty incorporating definitions 
into critical piecea of legislation. An 
example is the Carl D. Perkins 
Vocational Education Act of 1984 which 
mandates "assessment" services, yet 
provides no mention of who should 
perform the aeoessment, what it 
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incorporates, how long it should last 
and how it should be implemented. 
Unfortunately, oversights such as these 
create havoc for administrators placed 
in the positions of translating the 
" letter of the law" into practical 
applications. 

Our existence must be placed in the 
forefront of the arena so that the 
profession is given the highest regard. 
No longer can our professional voice 
remain silent. We must solicit support 
and bring forth a new visibility in 
order to ensure, to the greatest degree 
possible , that quality services are 
provided to evaluees. 

Diverflity of the Profesflion 

Vocational evaluation has gained a 
new popularity and is found in a variety 
of settings including: rehabilitation, 
private corporations , schools, insurance 
companies* industry, and hospitals* In 
fact, an ambitious evaluator can pursue 
any array of entrepreneurial directions 
which were unforeseeable in the early 
days of the profession. Our services 
have also expanded in that evaluation no 
longer Just looks at the individual's 
employment potential , but includes 
assessment for vocational education 
programming, social security disability 
benefits , employment-re.lated litiga- 
tions, personnel selection and work 
capacity/work hardening determinations 
(McDaniel, 1986). 

The diversity of settings in which 
vocational evaluation/ assessment is 
practiced also dictates a multi- 
dimensional atmosphere for learning and 
training. By setting, a natural 
tendency to cross-train occurs and 
professionals from other disciplines 
provide expertise while simultaneously 
gaining an awareness of the profession. 
In turn, evaluators benefit from the 
exposure to new applications of 
assessment services and different 
Pj.'of essional psrspectives . 

Although VEWAA has plays- 1 an 
important role in advocating for our 
professional existence , it cannot 
feasibly represent our many diverse 
roles and new directions. Other groupa 
such as the National Association of 
Vocational Special Needs Personnel, The 
Council for Exceptional Children - 
Division on Career Development, and The 
National Association of Rehabilitation 
Professionals in The Private Sector have 
continued to exhibit a growing interest 
in the practice of vocational 
evaluation/assessment . 

Collaborative efforts are necessary 
from a variety of professional groups, 
so that each issue is addressed and a 
stronger voice is heard. Developing 
ongoing working liaisons with ^elated 
professional organizations can h^lp to 
strengthen our position and increase our 
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advocating role. These organizations 
ahould be represented by as many groups 
as can be found among the diversity of 
employment positions vocational 

evaluation and assessment personnel now 
hold. Likewise, thorough representation 
should encompass the multi-faceted 
consumer groups which might utilize our 
services • 

Profsflaton Al Affiliation 

What is it that prompts profes- 
sional groups to come together and seek 
affiliation? Some reasons are 1) the 
existence of a need for mutual support; 
2) common activity; 3) the increase 
probability of success; 4) the common 
"predators"; 5) the opportunity to 
decrease ambiguity and anonymity; 6) to 
reduce discrepancy; and 7) to gain 
rewards and outcomes. (Mills, 1963) 

The multiple organizations 

currently existing (VEWAA, NARRPS, AACD, 
NAVAE, etc.) which represent 
professionals providing vocational 
testing and guidance certainly present 
with many, if not all, of the above 
elemonte and concerns. Our common 
interests suggest the possibility or 
growth through information exchange, 
mutual support and strength in numbers. 
To realize that the benefits of 
coalescing our various professional 
groups is not simply an internally 
inspired or self-serving process one 
need only consider the current: 
conditions affecting the "environment of 
the nations workers" (Swanson, 1986). 
Our nation is operating with a severely 
crippled free market; the average hourly 
earnings for non-farm workers after 
adjusting for inflation have been in 
decline for almost a decade; and the 
extent of income inequality in the 
United States is greater today than it 
has been at any time since the Great 
Depression. The significance of quality 
vocational evaluation, assessment, 
guidance and adjustment for all people 
entering or reentering the American work 
force cannot and should not be 
overlooked by poorly-informed consumers 
and legislators, or practiced by 
ill-trained, unqualified practitioners. 

In forming a coalition, it is first 
nscessary to 1) identify the represent- 
ative leadership; 2) arrive at a 
mutually acceptable position; and 3) 
develop a statement of issues and 
desired outcomes. (Parks, Henderson, 
1986) There are certain characteristics 
which are also critical to any alliance 
which must be addressed: 1) clearly 
defined mission; 2) emphasis on common 
ideology; 3) equal power among groups; 
4) effective leadership; 5) overlapping 
interests and frequent memV^er contacts; 
6) image of power; 7) variable 
resources; and 8) flexibility and 
willingness to compromiefi. (Parks, 
Henderson, 1985) Above all, there must 



oe a sense of strong commitment to the 
alliance and its goals. Given strong 
leadership, commitment, and a eound 
organizational structure , a group 
management process which has been proven 
effective over the years is the goal 
motivation (management by objectives) 
process. Essentially, goals are achieved 
by establishing the goal, designing 
activities to achieve this goal, netting 
timelines, and monitoring progress. 

A format for an alliance would 
include representatives from each member 
organization who would comprise an 
executive committee . These 

representatives would also be the major 
policy-making body. Their participation 
on the executive committee would be on a 
imembership rotation basis to allow the 
'least disruptive means of leadership 
'role initiation. Also, there should be 
[Standing committees to effectively deal 
!with ongoing functions and issues. 

In considering the formation of a 
nationally-based advisory group, one 
:muet first establish the common element 
■that will allow for a binding of effort. 
By history and definition, vocatioJial 
eva luation is tied to the field of 
rehabilitation and is guided by the need 
to be knowledgeable of functional 
aspects of disability and by system 
parameters. In contrast, assessment has 
been the description applied to services 
of vocational testing within an 
educational setting, requiring a 
different set of parameters. These 
jterms are used interchangeably yet 
trepresent very diferent meaninge. As a 
result, consumers remain unclear 
regarding services, which suggests a 
need for an appropriate term defining 
our "unique" body of knowledge. It 
would seem that a concept such as 
"vocational appraisal" put forth by 
Karen Pell Ayella and Pamela LeConte 
(1987) might well transcend the specific 
expertise of individual practitioners. 
'The definition of vocational appraisal 
as "any process of measurement of an 
individual ' s level of vocational 
functioning" could also allow for 
incorporation of the myriad of 
professional groups now involved in 
vocational evaluation and assessment. It 
is our suggestion that a national group 
be formed to bring together allied 
professionals who provide vocational 
assessment and evaluation services. This 
group might appropriately be named the 

Nnt,1o n»^ AdviBorv Council on Lasu^fl — in 

Vocflt-^Q^^l Appraisal . and be guided by 
the general mission: 

"To implement, enhance and retain 
the responsiblo practice of vocational 
evaluation and assessment by qualified 
individuals; encourage communication and 
leadership; recommend and promote major 
policy iseiueo and legislation affecting 
vocational appraisal". 
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means complete 
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the following organ iza- 
r own right, represent the 
r membership and provide 
a ted to their unique 
needs . However , these 
highlighted by their 
the diverse settings in 
ore are now employed, and 
to provide potential 
relevant assessment issues 
1 council. This listing 
council members is by no 
but should be viewed as 



Vocational RvAluA tion nnd Work 

Ad.lustment Aaaociation (UEWAA) . A 

division of the parent organization, the 
National Rehabil i tat ion Association . 
VEWAA exists for the purpose of 
improving and advancing the field of 
vocational evaluation and work 
adjustment for handicapped and other 
individuals with vocational problems by 
the use of simulated and/or real work in 
order to enhance their rehabilitation or 
habilitation (Davis, 1986). VEWAA was 
the pioneer organization representing 
the issues of vocational evaluation 
personnel . 

American VocQtional Awnnnifttion - 

Naulonfll Aflflnnia tion of Vocfttinn^l 

Aaaeesment in RrfnpAtion f navat?!^ . a 

special interest gror.p of the Special 
Needs Division of the American 
Vocational Association • NAVAE exists for 
the purposes of providing a strong voice 
for vocaoional assessment personnel 
within the AVA structure. Lixewise, 
NAVAE works to enhance the professional 
positions of personnel working in 
vocational assessment programs in 
education (NAVAE, 1988). 

Council lor Exooptionfti nhn^v^ftn- 

Divinion of Career Devfiloipment (CRC-DCD . 
A division of The Council for Excep- 
tional Children which exists to provide 
an organization for representatives from 
all disciplines who are involved in 
career development of exceptional 
children, youth and adults. In addition, 
DCD ssists other divisions of CEC 
interested in developing common goals 
utilizing career development concepts 
(Division on Career Development, 1987). 

The Asaociation for Perflona with 

S^yarfi HandlcQPfl LIASUi. An 

or£ianization which exists to enhance 
eduoutional programming, employment and 
training opportunities and improve the 
quality of life for individuals with 
Bevere handicaps. 

Amarliiaji..^k)j:;LLsLty. Qi Iiiaining.-.. ..and 

DcY al.QPJiieJlt .CASIl^i . A professional 

or^^anization dedicated to supporting the 
profoBoion anu buoineoo of human 



resources development . This 

organization typically provides advocacy 
for training professionals in 
busineps/industry settings (American 
Society for Training and Development, 
i9a9). 



National 



Aflffonifttlnn 



Rehabilitfttinn P»>nf i»,ftp,i o nftlB in thft 



Private 



Sftntor 



(NARPPS^ 



organization which exists for 
and/or organizations having an 
in the provision of rehabi 
services in the Private Sector ( 
divisions of this group are spec 
dedicated to Vocational Evaluati 
Hardening and Functional 
Assessment) . 



An 

persons 
interest 
litation 
separate 
ifically 
on. Work 
Capacity 



National AflflQciftt ion of VQGfttiQna ;L 

Sp ecial Needs Personnel (NAVESNP^ A 
special interest group of the Special 
Needs Division of the American 
Vocational Association. NAVESNP 
provides an association to support the 
interests of persons working with 
students with special vocational 
education needs. As a division of AVA, 
this group works to maintain active 
leadership in vocational, career and 
occupational education (The Journal for 
Vocational Special Needs Education , 
1988). 

National Association of School 
PsvohQlQalHtfl, A national association* 
representing the Interests and concerns 
of school psychologists and issues 
related to school psychological 
services. 



Amarican 



■^hY.fliii&l. 



Aflflofiifttion. A national association 
representing the interests and concerns 
of physical therapists. 

AmeriOan OnmnPfttional TH erftpiflta 

AasQQiation (AQTAK A professional 
society organized to represent the 
interests and concerns of occupational 
therapy practitioners and improve the 
quality of occupational therapy services 
(ACTA, 1989). 

American AaaoGiflt lon on Ment al 

Division nn 
A 



Retardfttin n (AAMR^ 

Vocationai 



Rfthabilitat ;l, Qp . 



professional organization which works to 
promote the well-being of individuals 
with mental retardation and supports 
those who work in the field (AAMR, 
1989). 

gQiml asiQn on (;erti£ icatiQn ol Vtoiji 

Adjuatmeat and Voaat icnal. Evaluation 

jpeolalistfl L gC WAV££l. A commission 

representing e ight professional 
organizations charged with developing 
dind implementing certification standards 
and procedures for the professional 
certification of Work Adjustment and 
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Vocational Evaluation Specialiate. 

This organization could provide an 
ad-hoc role to the council by offering 
advieement regarding the certification 
isBuaB. CCWAVES would offer an 
important advocating dimension to the 
council ae it draws membeiTehip from 
eight national organization© including: 
AoBooiation of Educators for 
Rehabilitation Facility Personnel 
(ABRFP), Association for Ketarded 
Citizens of_ the United States (ARC), 
Council of State Administrators of 
Vocational Rehabilitation (CSAVR) , 
Division on Career Development of the 
Council for Exceptional Children 
(CEC-DCD), National '\seociation of 
Rehabilitation Facilities (NARF) , 
National Association of Special Needs 
State Administrators (NASNSA), National 
Association of Vocational Education 
Special Needs Personnel (NAVESNP), and 
Vocational Evaluation and Work 
Adjustment Association (VEWAA)). 

Ifl^nwH in Vocfttionftl Evaluatift n and 
AaflOflflglQnt 

Although the representatives to 
this council will bring diverse views 
(by nature of their association), they 
share related interests in the effective 
delivery of vocational appraisal 
services. Inherent to each of these 
groups is the responsibility to present 
their memberahips at locals state and 
national levels, ahd ensure that their 
views are heard. 

Similarly, the National Afivlflorv 

CQunQll on l aauaa 4n Vnfiaf.iQrual 
jftp praiaal oan provide advocating 
support > direction and advisement on 
critical issues affecting the practice 
of this service. In particular, this 
council could provide support on the 
following issues: 

o Encourage linkages between 
professional groups involved in the 
practice of vocational assessment > 
evaluation » and related services. 

o Ensure a procedure for quality 
control and program evaluation for 
programs providing vocational appraisal. 

o Provide a unified professional 
voice for vocational evaluation/ 
assessment personnel regarding federal 
legislation which affects the profession 
of vocational appraisal. 
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PRE-EMPLOYMENT PUACKMEMT SCREENING! 
A GUIDE TO BHPLOYABILITT 



SalHe E, Taylor, MEd. , O.T.R. 



ABSTRACT 



In recent months employers, in the 
interest of reducing on the job injuries, 
have looked to work hardening therapists 
or physical capacity evaluators for 
information helpful in considering 
prospective new employees. The result has 
been the growing popularity of pre-placement 
screening testing. Pre-placement screening 
is generally 1 component in a multifaceted 
selection process for either prospective 
employees or for employees who seek to 
transfer from one job to another within the 
.ame company. The proapective job applicant 
is tested in physical performance against 
critical (at riak) components of the specific 
job for which he or she ia applying. 
Information for this performance component is 
evaluated with other application information 
by the employer in the selection and 
assignment of personnel. 

While the vocational evaluator or 
rehabilitation counselor and hi» or/her 
client^have in the past felt confident in the 
client'! ability to perform a job» they may 
now with increasing frequency be asked to 
demonstrate to whe employer's satisfaction a 
level of physical perf or.iii*nce compatible with 
requirements of a job before hire. 
Implications of this emerging trend are 
discussed in this paper. 



INTRODUCTION 

^More than any other decade, perhaps, the 
1980'8 haa witneesed significant changes in 
business practices- Almost everyone today has 
known someone, or perhaps haa experienced 
first-hand the effect of a merger, takeover, 
or downscaling of a business. These events 
have become hallmarks of this decade. In 
their wake employee turnover has been high. 
Workers have been outplaced or laid off in 
droves . 

In the midst of this changing workplace, 
a trend is immerging in which companies are 
taking great care in the selection of their 
work force. More than ever, considered effort 
is being made to hire the best candidate for 
any given job. 



PRE-PLACEMENT SCREENING 

For years companies have used pre- 
employment testing to aid in employee 
selection. The physical examination and the 
back x-ray are 2 famili-ir pre-employment 
teats of general health. Skill tests such as 
typing and transcription have long been 
uoeful in employee selection. Perhaps it is 
juat a natural extension of thia practice 
that companies have recently begun to seek 
information regarding the prospective 
employee's ability to perform taaks at the 
specific physical demand level required by a 
given job. Across the country, agencies 
providing work hardening therapy report that 
they have been approached by companies which 
have asked for job specific performance 
testing for either prospective employees or 
for workers requesting transfer to another 
job. 

The pre-placement physical performance 
screen usually determines the general level 
of work at which an individual can function 
safely. The level corresponds with one of 
the US Department of Labor's classifications 
of work based on the physical demands of 
jobs. Most typically, a pre-placement 
screening test will report amount of weight 
lifted in several r.inges from floor to 
overhead. Some observation will also be made 
regarding safe lifting techniques used during 
testing. These dflta are used along with 
other information available to the human 
resources staff in making job placement 
assignments and hiring deciaions. 
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Employers like the pi'e-placement test 
for several reasons. If the test design well 
simulates the work to be done, the employer'^s 
exposure to compensable injury is very likely 
reduced. Vulnerability to discrimination 
against a prospective employee is also 
lessened, for in advance of hire or transfer 
there is aviiliible information regarding the 
individual^'s physical capabilities and safe 
or unsafe body mechanicr; practices. 

In pr e-placement physical performance 
screening, some employers seek only general 
information, asking only the US Department of 
Labor work level classification at which the 
individual can safely function. By far the 
majority of companies, however, are looking 
for job specific evaluation of prospective 
employees. This calls for the establishment 
of a testing protocol for the particular work 
that the individual will be expected to 
perform, if placed in a given job. Care must 
be taken to insure that the test is 
translated from the actual job the applicant 
will perform. 

The following is a list of the steps 
necessary in the establishment of a job 
specific pre-placement physical performance 
screening test: 

l» Review the company ''s OSWA Logs to 
see if there is a pattern of 
injuries in the job. 

2. Review the Dictionary of 
Occupational Titles description af 
the job for general characteris ics 
which may be expected in the job. 

3. Go to the company and see all 
aspects of the job as it must be 
done by the individuals who are 
currently employed in the job. 

A. By observing workers in the job 

establish time/mot ion/method data 
to incorporate into the test. 

5. Identify the components of the job 
that are the most stresaful, and 
that place the worker at highest 
risk for injury. 

6. ^leview findings with company 
management to insure that you are 
in agreement about the demands of 
the job you have observed. 

7. Decide with management whether 
testing will take place at the job 
site or at an off-site facility. 

B. Simulate as many high risk 
components na necessary to 
determine the appUcant^'s 
capability of performing the work 
safely . 

9. Fiiime th(» tos componenliJi in a 
standardized testing protocol. 
Write out the test, especially the 



« instructions to be given to the 
prospective employee. 

10. Formulate the written report. 

11. Review the entire package with your 
attorney. 

12. Review the entire package with the 
purchasing company, so that 
everyone understands what will be 
done and what will be reported. 

Only when these steps have been 
accornpliehed is it time to begin scheduling 
individuals fcr screening. It is important 
to screen only those applicants who have 
already received a clear bill of health from 
the physician in a pre-employment physical 
examination* 

IHFLICATIONS FOR VOCATIONAL BVALUATORS 

Vocational evaluators have a well 
established tradition of carefully evaluating 
the various components of work such as 
aptitudes, interests, temperament and skills 
in preparing clients for employment. With a 
growing trend toward performance testing in 
pre-placement screening, the vocational 
evaluator's client's may likely be required 
to demonstrate physical strength performance 
before hiring into a targeted job. The 
individual who demonstrates safe body 
mechanics along with required strength and 
agility will very likely receive more 
favorable consideration for placement than 
the individual who performs marginally. 

In anticipation of the requirement of 
pre-placement testing, several steps may be 
taken. Prior to committing to a training 
program, the vocational evaluator may wish to 
have the client engage in some level of 
testing to determine strength and body 
mechanics performanc This could be in the 
form of a feasisbilit> t as many work 
hardening facilities noi ffer. These tests 
are usually 4 hours to 5 aaya in duration and 
are priced accordingly. Through either 
simulation of a p/jrticular job or a series of 
tasks performed a: a designated work level, 
information is obtained concerning the 
individual's feasible work level 
classification, described in terms of 
strength, endurance, and safe working 
pract ices • 

Pre-placement screening may, in some 
cases, pi ^ide an altemfltive to feasibility 
testing. A'hese tests typically run 1 to 4 
hours in length, and are priced accordingly. 
These tests do not generally discuss 
feasibility, but do usi ally provide detailed 
performance data. The reader of the report 
is left to formulate bie own conclusions 
r egard ing f eas ibil i ty . 
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The vocational evaluator may elect bo 
defer testing ro the end of the vocational 
training period, closer to the time the 
client is actually looking for placement. 
Again, the evaluator may have the client 
engage in pre-placemen t screening to 
determine if he meets physical demand 
requirements or if a short period of 
conditioning - i.e. strengthening or body 
mechanics training- will provide the 
individual with added advantage when he 
applies for a job. 

One approach that could work very nicely 
is for vocational evaluators and occupational 
or physical therapists to establish a 
business relationship. Such a relationship 
could be ('-signed in one of several ways. 
The therapist could serve as a consultant to 
the vocational evaluator and could be colled 
in on fin "ss needed" basis to provide 
evaluation in the areas of physical demands 
concerns. This model makes the therapist a 
member of the evaluntor's staff, provides 
whatever services may be required in the 
evaluator's facility, and is generally one 
more resource the vocational evaluator has to 
offer in the market place. 

Using a different model, the vocational 
evaluator may buy pre-plac emen t testing by a 
therapist on an individual "as needed" basis. 
This testing would take place in the 
therapist^'s facility as a purchased service. 
If remediation is deemed necessary, this 
service may also be purchased from the 
therapist. 

SUHMART 

In the competition for jobs in the late 
198C's and moving into the 1990'8, a new 
dimension has been added: pre"*p laceroent 
performance screening. With management's 
increas »d concern about compensable injury 
and about nondiscriminatory hiring practices, 
performance data is becoming an important 
component for consideration by the employer 
for job placement, either at the point of 
hire or of transfer. Care regarding 
body mechanics techniques and concern that 
the prospective worker can physically perform 
all parts of the job are reasons companies 
are using pre-placement screening tests* By 
recognizing this immerging trend, vocational 
evaluators can help their cliencs prepare for 
this challenge and win from the start as they 
move successfully into the work force. 

/Vjthor: 

Sallie E. Taylor, M.Ed., OTR 
Chief, Industrial Rehabilitation 
[)LpartjTie;it of Physical toJicine, and 
HealthLinG Corporate Health Services 
St. Louis University Hospital 
St. Louis, MO 
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CARl£ER ASSESSMENT TO FACILITATE ADULT LIFE TRANSITIONS 
A Post-Secondary Lifeskills and Career Guidance 
Curriculum for Women 



Linda Mul 1 ins 



Oirf?ctor of Vocational Testing 

Mineral Area PoUpge 
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ABSTRACT 

New opportunities in education and work are 
available for women. Some d i sadv-^ntaged women 
want to participate in these trends. The 
present academic and economic 
these disadvantaged women 
successful re-entry into the 
environment unlikely and "RISKY", 
a transitional curriculum"^ designed to 
facilitate change for this 'at risk" 
population was developed. Used with this 
population, Vocational Evaluation becomes the 
method by which these women assess their 
abilities, organize their preferences) gather 
information about the world of work and make 
their vocational plan. The Mineral Area 
College Vocational staff has realized that 
some women have not developed a strong fantasy 
life regarding themselves as workers. Some of 
them have never "pictured" themselves working 
outside of the home. Some of the women who 
take part in the program have a limited "paid" 
work experience and work tasks outside of the 
home seem threatening to them .Vocat ional 
Evaluation provides work related "feedback" to 
these adult students many of whom have been 
out of the career/educational setting for 
years. These students in Vocational 

Evaluation typically use paper/pencil measures 
such as the COPS , CAPS , and COPES to measure 
abilities, interests and values related to 
work. Self-scoring and a good deal of self- 
interpretation with instruction is used to 
reflect the reality that each of these adults 
sees in her own life. 

Work samples (27 total in the Vocational 
Evaluation Lab) and assignments to da "job 
shadows" are used to provide hands-on exposure 
to the world of work. Students search the 
Missouri VIEW, Dictiona r y of Occupational 
^^^l.gs and the O utlook Handbook to gain 



information before they 
evaluator . 



make plans with the 
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Vocat ional AsseEisnient 

The Center of the Transitional Curriculum 

The Women in Transi t ion program 
selection of courses designed to 
economical 1 y di sadvantaged women gai n 
skills and self-esteem necessary 
successfully make the transition back into the 
classroom and into the world of work. The 
majority of women who participated sought to 
make a transition in their lives from 
rel i ance on pub lie economic suppor t to a 
read iness for f i nanc i al sel f-suf f i c iency , 
Developers of the program saw vocational 
evaluation as a key component, 
vocational potential fit well 
objectives of (a) developing 
personal management ski 1 Is, 
career decision making and job search skills, 
and (c) increasing basic academic skills 
including G.E,D. preparation. For purposes of 
this paper only the assessment componenv will 
be discussed at length. 

In the last four years at Mineral Area 
College, the approximately 150 economically 
disadvantac ed women who have participated in 
the Women in Transition Program at Mineral 
Area College completed a course entitled, 
"Vocat ional Evaluation" as part of their 
transi t i onal cur r i cul um. Voca t iona 1 

Evaluation is an individualized career 
planning course which includes aptitude 
test ing , i n vent or i es of both i n teres ts and 
values, "hands-on" experiences of work tasks 
through performing work samples or doing job- 
shadowing, and the gathering of information 
about the current world of work. 

Prof i les of the Par I ic ipants 

Data is being presented here which 
provides a brief profile of the participants 
in the Women in Transition Program, 
(Mul lins, 19Q7) , 

* Seventy**f ive percent of the women who 
participated m this progr-^m were between the 
ages of 20 and 3^*. 

* Over half of the participants were 
rrce ivi ng f i nanc i a 1 suppor t through the 
Division of Family Services: Aid to Families 
with Depende.it Children. 

* Sixty percent of tiie participants had 
dropped out of high school. Of these, 51/. had 
not obtained a G,E.D. 

» Ninety-seven percent of the women who 
participated Wf?re mothers, 

^ Twi^nty- three perceiil of the 

participants had no pr evious work experif?nce. 
Fifty-four percent rppurted that they had lei',s 
than two years of work expsrience. 
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Economic NbpH Provides Impetus f or Cnanqe 

A survey conducted bv Arbeiter, Aslanian, 
Schmerback andarickell (1978) reported that 
36'/» of the population between the ages of 16 
and 65 (more than '♦O million Americ.ins) are in 
a career transition status. The transition 
status was defined as either "actual 

(e.g. unemployed and looking for work* etc.) 
or "anticipatory" (e.g. dissatisf ip?d with a 
current job and considering a new career, 
etc.Xp. 7>. The economically disadvantaged 
women who participated in the Women in 
Transition Program were, like millions of 
Americans, seeking change in the economic 
status through career development. 

Education Lessens the Turmcil of Change 

In a thoughtful essay on the 
relationship between adult development and 
education, Lasker and Moore (1980) speculate 
about the profound effects which education can 
have on development. They assert that: 

By raising consciousness prior to actual 
events, education can create a hybrid 
mentality that knows before it experiences. 
By aiding the anticipation and understanding 
of transition (italics added) education may 
lessen the turmoil of change, (p. 35) 

Vocational Assessment used as an 
instructional tool provides adult students in 
the '^lomen in Transition program with the 
opportunity to raise their consciousness about 
themselves as workers. It allows students the 
opportunity to anticipate some of the changes 
which they will need Vo make as their carf?er 
paths change. In doing so, the vocational 
evaluation process fosters the desired change 
and "lessens the turmoil". 

FmPlovn^ ftnt Concerns 

Major Factor in Adult Learning 

Arbeiter, et al (1978) state that "the 
Learning Society is with us," Lifelong 
learning has become an integral .^art of a 
post-industrial society. The return to 
education for the adult fills the need for 
self-renewal » for advancing a job or career 
with continual I y changing requirements, or 
allows the individual to accomplish tasks 
which were perhaps not accomplished at an 
earlier stag© of development (pg. 6). 

In a "Learning Society", Arbeiter, et al. 
(1978) asserts "Adults wl 1 1 exper ience many 
transitions during various life stages. 
Individuals will need to appraise thsir 
abilities and interests and ease the 
transition between vocational and/or 
avocational pursuits" (p. 6). 

Thf? U. S. Department of Hrallh, 



Education and Welfare* National Center for 
Education Statistics, (I97c?) related that the 
reasons participants take adult education 
varied from advancement in career to social or 
recreational. However, job related issues are 
the most frequently cited reasons. Combining 
the '♦2.7'/. o*;" adults in education who stated 
that advancement in work was their primary 
reason for continuing education with the 11.3'/ 
who gave job acquisition as a reason, it 
appeared that over 50'/» of adults in education 
are there because of employment concerns, (p. 
71), The participants in Women in Trarution 
fit' this national trend. Employment concerns 
caused them to seek education. Vocational 
Evaluation used as their first step in the 
educational process increased the possibility 
that .he educational path which they chose 
would lead to successful vocational 
deve I opment . 



Vocational Assessment 
From the Adult Perspective 

Adults who are selecting a career path 
need to assess their own abilities, organize 
their preferences, "see" themselves in a new 
working way, gather information about the 
world of work, and make a plan for the 
vocational change ihey want. 

Assess Abi lities 

Aptitude testing for the adult who is 
selecting a new career path provides current 
"feed-back" . Years away from the formal 
academic environment leaves previous testing 
data perhaps at best ou t* of -reach . More 
importantly, this data would likely be out-of- 
date. Sixty percent of the women who took 
par/ in the Women in Transition program 
drop ed out of high school. These students, 
as well as those who were more successful m 
previous educational environments need 
current informaticn to help thc:r. predict 
success in a selected training program or new 
career field. 

As part of the Vocational Evaluation 
course* each student takes a general aptitude 
test. The CjirrrMi, fihi^'^^^^*^ P Bremen t Survey 
{CAPS2, is used. The results of this 

^^^^^ement provide the student and 
instructor/counselor with current information 
on which '0 focus. Students score their own 
work which increases the likelihood that they 
will view resul ts both understandable and 
tentative. The counselors empha^.uze the fact 
that paper/pencil test scores only attempt to 
measure the student's capabilities on the day 
of i-^stinq. Stanine scores on each section of 
the CAPS i.lp/irly indicate where impr o vc^ments 
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(if any) need to be made to predict success in 
any given field of work. 

Adult students using this test confirm 
their potential for success in a given career 
or obtain current information about what 
changes reed to be made to predict the success 
desired . 

Organize Preferences 

While many adults may "know what thoy 
like and dislike", it is often not apparent to 
these same adults just how their preferences 
would suit them for particular types of work. 

Preferences for certain activities and 
lack of appeal for others usually appear to be 
rather random "feelings" to the adult 
student, When faced with the opportunity to 
select a career path or the need to make a 
career plant most adults can benefit from a 
method to organize these work related 
preferences. Adults need to see how their 
likes and dislikes form patterns. These 
patterns can then be used to indicate which 
fields of work would provide the most 
opportunity to do the kinds of activities 
which they like. 

Oncff thsse preferences are organized, 
then thff crucial step is to provide the 
student with the names of Jobs which fall 
within the preferred of work. A number of 
interest inventories art used on a routine 
basis in the Vocational Evaluation course. 

The Career Occupational Preference 

Survev(CGPS) is used most frequently. It 
provides our adult students with immediate 
information about their fields uf preference. 

"First-hand" and "Hands-on" 
E xposure to Jobs 

Adults who are making a career plan and 
ir particular adult women participating in the 
Women in Transition program need "hands-on" 
experience of work tasks and career options. 
Approximately 25'/. of the participants reported 
that they had no previous paid work experience 
anr) an additional 25'/ reported that they had 
leus than 8 years of paid work experience. 
^Mullins, 1907) These students benefit 
greatly by using any of 27 work samples which 
are available in the Vocational Evaluation 
Lab. These are mostly Singer and Choice Work 
Samples, A complete list is provided in the 
append i x . 

First-hand information about careers of 
choice is obtained by each student as they are 
assigned the task of interviewing someone who 
is presently doing the type of work they want 
to pursue. It easier for one to under^itand 
what is needed to become a successful nurse, 
carpenter, electrician or dental assistant 



for the course including doing research on 
their chosen field. Grades for the class are 
established on the basis of tasks completed 
and worker characteristics (reliability and 
at tent ion to tasks ) . 

Summary 

The Vocational Evaluation Center plays an 
integral part in the successful transition of 
new students, both male and female, onto the 
Mineral Area College Campus. Special Needs 
students, typically economically and 

academically disadvantaged and/or handicapped, 
need career direction. The Center is funded 
through the Missouri Department of Elementary 
and Secondary, Vocational Special Needs and 
Guidance Services. 

Append i x 

VOCATIONAL EVALUATION CENTER 
MINERAL AREA COLLEGE 

Below is a sample of Singer Work Stations, 
tests, interest invtntories, and CHUICE 
compu ter i zed programs wh ich are ut . 1 i zed in 
the Vocational Evaluation Center. 



SINGER WORK SAMPLES 

Air Conditioning and Refrigeration 
Basic Laboratory Analysis 

Building Maintenance 
Carpentry and Woodworking 
Computer Science 
Cosmetology 
Data Calculation and Recording 
Draft ing 
Electric Wiring 
Electronic Assembly 
Household and Industrial Wiring 
Medical Services 
Needle Trades 
Cffice Services 
Plumbing and Pipefitting 
Samp le Mak ing 
Sheet Metal 
Small Engine Service 

Order i ng I nf ormat i on: 
New Concepts 
1802 N. Division St. 
Morris, IL 60^i50 



CHOICE WORK SAMPLES 

Computer Literacy 
Data Preparation/Entry Clerk 
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Bank Teller 
Accountant 
Programmer 
Word Processing 

Ordering Information: 

Al I ison Assoc iat ion 

Box 313 

Troy, MI ^B099 
(313)689-2990 



PENCIL MEASURES 

Career Ability Placement Survey (CAPS) - The 
CAPS is a comprehensive, multi-dimensional 
battery designed to efficiently measure 
abilities keyed to entry requirements for the 
majority of jobs in each of fourteen 
occupational clusters. There are eight 
sections, each with a five (5) minute time 
limit. Examinees complete the summary 

activity section which allows them to 
determine their personal areas of abilities as 
well as related occupations within these 
fourteen clusters. 

Career Orientation Placement and Evaluation 
Survey (COPES) - The COPES provides 
comprehensive measurem^.^nt of those personal 
values which have a demonstrated effect on 
vocational motivation and values. 

Career Occupational Preference Sur ./ey (COPS) 
The COPS provides a measure of interests 
related to fourteen occupational clusters. 
Students can research jobs within each 
cluster, using th« workbook which is attached. 
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On-The-Job-Evaluations: Past, Present, and Future Trends 



Philip D. Kell 



Abstract 

The \ ocational evaluation "tool" known to many 
of us as the Job Site Evaluation, or OJE, has not 
received as much scholarly attention or utili^ 
over the years as other vocational evaluation 
tools. Psychological tests and woricsamplea arc 
less expensive (i.e. time donsuming) than OJEs, 
and, to many an evaluator, such quick methods 
meet their fiscal needs; therefore, there is a 
strong inclination by many vocational 
evaluators, and other rehabilitation professional, 
to rely almost exclusively on psychological tests 
and worksample systems. Tliere does appear to 
be specific qualities of an OJE that lend 
themselves to addressing specific questions of 
job readiness perhaps better than any single or 
batteiy of constructed tests or task simulated 
dcwces. If we can better identify these qualities, 
perhaps then well know better how and when 
the OJE might be used. 

The purpose of this study was to review the past 
and cvrrent literature about OJEs, and compare 
the various methods and formats being used in 
the development and implementation of 
conunumty-basedOJBs. Similarities and 
vanations m OJE designs were noted, theoretical 
and applied models identified, r-^si and cuircnt 
topical issues reviewed, and future trends 
discussed. 



In the early 1940s, the Job Tryout was 
being used in the senior high schools, and being 
considered for use at the junior high level as 
well (Myers, 1941). The purpose of such a Job 
Tryout was "...to furnish a tiyout or an 
exploratory business course that will aid all 
pupils in discovering whether or not their 
uitcrcsts and abilities arc in the com.Twrcial field, 
and aid pupils in choosing the kind of work to 
enter" (p. 139). 

Course work involved field trips and 
"work experiences" to gain the most beneficial 
effects for those future workers. The work 
programs were called cooperatives or 
apprenticeships; they involved some job 
training, evaluations, and job exploration - but, 
course work was tlic primaiy means for 
training. Myers (1941) remarked that "...actual 
conditions of employment as to hours of work, 
production, social environment, etc., are not 
reproduced in the school exploratoiy work. On 
this account.. .some pupils...find themselves 
unsuitcd to the same woik under actual 
conditions of industry or business" (p. 154). 
Hence, Job Tiyouts were recognized by 
vocational guidance counselors of the 1940s as 
being an effective tool in their vocational 
planning of a non-disabled population. The 
SWEP programs and other school work 
programs still offer these kinds of experiences 
today. 

A nineteenth centuiy industrial 
psychologist , Hugo Munstert>erg (1912), 
thought that training and woric experience were 
essential in order for anvone to make a correct 
vocational choice. Professor Munstcrbcrg wrote 
extensively on the subject of vocational decision 
making, and other subjects associatwl with 
applied industrial psychology. His concern was 
that people were being too. random in their job 
selections: "...there is no more momentous act 
in the individual development than his choice of 
life work. No decision ought to be taken with 
greater care..." (p. 20). He went on to state 
...the learning of the knowledge and the 
training in the practices of doing certain acts arc 
both indispensable..." (p. 38). So, the 
abstract, isolated skills arc not enough; the 
person must not only know the steps, but 
experience the integration of each part as the 
whole. A kind of choreography of work takes 
place in the real Job experience. 
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In Munsterberg's time, the industrial 
section of this country had a need to determine 
who mi^ht be best to perform certain jobs, but 
companies did not want to jeopardisx 
equipment, time, or efficiency to test people 
on-the-job. The work sample was the answer to 
this predicament. Is it still the answer ? Arc 
OJEs or Job Tryouts really needed ? In a very 
real sense there is no one solution for everyone 
in preparing for work. 

In most psychological theories, there is a 
graduad, developmental model; children grow 
and develop in a '^transitional" manner Most 
learning occurs gradually; new knowledge is 
built upon older information, etc. It seems fair 
and reasonable to suggest that becoming ready 
for work requires the same graduali 
"transitional approach. The initial diagnosis of 
the person's disaoility, medical data on any 
limitations, psychological data on emotional 
and/or cognitive parameters, measures of 
various factors (i.e.psychometrics), use of 
worksamples to get indications of abilities, work 
behaviors and speed of learning new tasks, all 
of diese elements lead to selection of the most 
appropriate work environment This type of 
information is indispensable in job site selection, 
but by itself, this data may not be sufficient in 
manycasrs. The OJE can be that final phase 
prior to any additional job skills training or 
direct job placement 'fhe OJE by itself may not 
be enougii, nor arc '^ny of the other measures of 
human work potential sufficient by themselves, 
but together they work well 



; dvantag ea of thft OJE in Vnciitional 

EYBlMfltions 

In a 1978 paper, Karl Botterbusch 
answered the question "Why use job site 
evaluations (OJEs) T by using one word 
"Realism" (p. 3). It could.be argued that not 
everyone is ready for "realism", but they mi^hi 
one day become ready. Client's with Chrome 
Menial Illness with limited management of their 
illness, may not be ready; or, Dcvelopmentally 
Disabled adulU with no work experiences may 
n/^^/^: be ready. Some advantages of the OJE 
include job exploration, surveying personal job 
preferences, development of beneficial work 
habits and realistic expectations, development of 
work related social skills, and a chance to 
improve one's self-esteem. 



Another benefit of the OJE is ilbuuatcd by Q. 
Gustin in a 1978 article in VEWAA Bulletin. A 
client had completed vocational evaluation 
(worksamples & psychometrics), and had been 
assigned to an On-the-Job Training site (OJT). 
A few weeks into the OJT, and the job site 
supervisor stated that the client was not working 
up to the levels of potential stated in the 
vocational report An analysis of the data was 
done, and revealed no problems. Then the staff 
discovered that the client had stopped taking his 
medications. The staff believed that had this 
person been on an OJE prior to his OJT, this 
problem would have been predicted and job 
training time not wasted and the confidence of 
tlie client and employer maintained. 

P. Como (1985) wrote on the subject of 
"employability". It was indicated in this article 
that the OJE pravides an advantage in 
determining employabili^. He defined the term 
employability as "...the ability to perform some 
task(s) or behaviors that add a net value to some 
company's product" (p. 165). He identified 
four basic habilities that subtract from this 
"employability''; 1) Any wages or dinsct labor 
costs, 2) benefits or indirect labor costs, 3) the 
impact of any perceived or real negative or 
deviant behaviors (a real concern of many 
employers), and 4) the perceived cost to the 
company for the risk in working with persons 
with a disability. It's been my personal 
experience that the last two liabilities carry most 
of the weight of concern. A major benefit in 
dispelling such concerns with accurate 
infomrutfon can be the wider use of OJEs. The 
employers m not committed to hire, yet they 
have an oi^^rtunity to see that persons with a 
disability can be good workers. While the client 
is arldng an opportunity to demonstrate their 
abilities, the employer is becoming desensitized 
to persons with a disability. The public relations 
benefits can be enormous for the rehabilitation 
clients and specialists. 

Another positive aspect of the OJE, is its 
usefulness across a broad «^jctrum of disability 
groups. The following list of disability groups 
have been served by the OJE model: 

1) Head Injured (Weinberger, 1984) 

2) Chronically Mentally/Emotionally Disabled 

(Oerbcr, 1979) 

3) Blind and Visually Impaired (Leach, 1976, 

an^i .Tcnes, 1976). 

4) Hearing Impaired/Deaf (Fiy, 1987). 

5) Cognitively Impaired (Fry, 1987). 

6) Physically Disahled (Green, 1973). 
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Ms. Wcinbcrgernotcd several positive 
outcomes in using the OJE model with person's 
with Brain Injury: 

"The cvaluaior was able to assess the types of 
specific work skills that the patient was capable 
of performing and devise an effective method 
for the patient to learn tasks while compensating 
for cognitive deficits." 

This imomuition turned out to be invaluable in 
client's eventual competitive job placement 
Other advantages are noted or can be infeiwl by 
some of the ongoing research and/or reported 
experiences. Based on an "ecological systems 
perspective" (Szymula, 1984), it cab be infeired 
that the best way to understand or assess a 
persons' behavior is to assess that behaviw in 
the social environment that it occurs. These 
"ecolo^cal" or social systems spoken of suggest 
a sophisticated adaptive and coping strategics 
need to be learned oy those within the system. 
The OJE makes interactive demands on the client 
that might be deminished or non-existent in a 
simulated test environment. 

Docs this "social ecology" mean that tests 
and worksamples have no place in vocational 
evaluations - m my opinion - no. The OJE is the 
final, as well as different, phase of a complete 
vocational evaluation process. While the 
psychometrics and worksamples do look at the 
mdividual traits and simple combinations of 
those traits, the OJE looks at the interactions of 
these same trails in a more complex 
inier-rclationship; i.e. in the act of functioning 
comprehensively to form productive work. 

Botterbusch (1978) mentions a powerful 
advantage of the OJE over other assessment 
devices, and that is there is no concern for 
validity, or reliability, concerns about normative 
data, or corrjpliance with currrnt industrial 
standards. Every OJE site has the inherent 
demands of that job in its present fonn; i.e. if 
the person can perform thq iob to the satisfaction 
of the employer and the industry, the person can 
be trained and work in that job. 

Another possible advantage in using the 
OJE in Vocational Evaluations is related to 
Pcrske's (1972) article on the dignity of taking 
risk. He was primarily speaking about persons 
with developmental disabilities, but this might 
be a concern for all rehabilitation clients. The 
primary concern being that if one uses only 
simulated work environments, the risks inherent 
in work arc minimized by staff, and false 



expectations on performance can be fostered in 
the client In addition to the implied concerns of 
Perske, Hanley-MaxweU (198oa & b) sees 
interpersonal problems as a major concern for 
the disabled and able-bodied in getting and 
keeping a job. The real advantage to the OJE 
seems apparent in that everything on an OJE 
occurs in its real social context; spontaneous 
events occur and must be dealt with in that 
unique context 

Others asserting this primacy of th^ 
Emotional/Social domains include Dr. McCarron 
(1976). He asserted in his vocational scale used 
in the McCarron-Dial work evaluation system^ 
the primacy of the Emotional-Behavioral, ai 
well as Coping-Adaptive, factors in his levels of 
vocational competencies. These factors took on 
greater importance as the level of vocational 
competency was increased; i.e. Competitive 
Emplpyment level requires greater sldUs in die 
Emotional-Behavioral domuns than Sheltered 
Employment or Supported Work. In the OJE, 
all these factors stated by Dr.McCarron are 
addressed. Thus, the utility of the OJE in any 
evaluation wishing to assess these behavioiil / 
adaptive domains will find the OJE a very useful 
device. Another advantage mentioned (Hursh, 
1983) was that the results from an OJE arc more 
likely to meet with resistance from the client than 
psychometrics or worksample results. 

In addition to all the other advantages 
mentioned so far» a well run OJE program can 
pronK)te your facility in the community, and 
rehabiliution in general. The OJE can be a very 
powerful Public Relations tool. An additional 
advantage mentioned (Hurshi 1983) is that 
research suggests that tested traiu or skills do 
not easily generalize to other competitive work. 
The OJE provides a forum for dealing with this 
issue; the measured traits, aptitudes, and abilities 
can be put to the test in a real job situation. 



Disadvantages to thft QJE m VocA^gnffil 

EvaluatjQnii 

The skills needed bv evaluators to develop 
and maintain an OJE model (Hursh, 1983) geu 
into complex numagement skills. The evaluator 
must move freely from the client to the 
supervisor/employer, fellow employees, and/or 
any Unions involved. In addition, scheduling 
times, any wages, insurance concerns, all must 
be addressed. This gives an indication of why 
the OJE is sometimes avoided Tlie most 
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difficult pan is gcUing started. Some people 
recommend a non-payment during OJbs, but my 
experience is that pay ment of minimum wage 
makes the OJE experience real; the client works 
harder, the employer expectations are not 
reduced, and the motivation to progress is 
probably maintained or even increased 

The more varied skills required by staff, and 
longer staff time involved can ceitainly be 
prohibitive. It's been demonstrated that as the 
degree of "reality" of a vocational technique 
increases, so does the cost (Botterbusch, 1985). 
The point being, perhaps, if one wants more 
accurate information, one must pav more. A 
poorly planned OJB program, besides giving 
useless data, could result in increased isolation 
and mistrust of the rehab, facility by the 
business community. Also, a poor placement 
could result in unnecessar> delays and a 
disgruntled client and employer. The accurate 
vocational test data and proper preparation can 
prevent, or at least minimize, these types of 
events. 

OJEs take a great deal of work, long term 
maintenance, and community involvement An 
example of the level of community involvement 
can be illustrate by our own Job Placement 
person at our facility (the Evaluation & 
Developmental Center; a comprehensive 
rehab.facility in the Midwest). He is involved 
with several local organizations, and is currently 
running for City Council Member. Of course 
not everyone has to be a member of their city 
council - hutf it sure helps. Some business 
background can be very oeneficial as well in the 
vocational end of rehabilitation. Our Job 
Placement Specialist* with the assistance of our 
vocational evaluators, develops OJE, OJT, and 
Job Experience sites in the community, as well 
as woixing direcUy at competidve placements. 
The Job Placement Sjpecialist already has a 
foot-hold at community job sites, and can be 
indispensable in developing OJE sites. Just 
because it's an evaluation, doesn't mean that the 
evaluators should do all the coordinating. 

The primary disadvantages to using the 
OJE in a vocational evaluation process would be 
staff time, staff development, procedural and 
organizational development - i.e. money. OJEs 
arc an expensive proposition - at this time. This 
makes the wise and discriminating use of OJEs 
all the more important If you use an Ojc, 
you'd better not be able to get the same 
information you need somewhere else cheaper - 



e.g. tests, worksamolcs, situational 
assessments, etc. Obviously, tiie advantages to 
using the OJE, in certain cases, outweighs the 
disadvantages; however, the primary 
disadvantage (money/time) can carry the veto. 



Developing OJE Sites 

There aj^ars to be three central 
processes or steps involved in any OJE 
program: 1) Development of the OJE site in the 
conmiunity, 2) Proper evaluation of the client on 
the job site, and 3) The maintenance of the OJE 
site for current and future considerations. The 
evalnator will need to think in terms of an 
on-going relationship with the employer that 
needs to be appropriately nurtured. The object 
is always the successful termination with the 
client - not the employer or business. Not only 
must the site be properly developed, but 
properly directed, and properly terminated for 
future use. The long-view must always be at the 
forefront of the vocational specialists mind. 

Forms used in OJEs can be obtained 
through Materials Development Center, 
University Wisconsin-Stout. You could 
develop your own, but the better way is to use a 
form already in use; modifications can be made 
for any special needs. In general the fomi 
follows the function or purpose of the OJE in a 
particular case. Karl Botterbusch (1978) offers 
steps in the process of developing OJE sites, as 
well as insight into some legal issues. In 
general, my personal experiences have been in 
agreement with Botterbusch's suggestions, llis 
"A Oulde To Job Site Evaluation'^ is an 
excellent study guide for anyone thinking of 
using the OJE, and even for those who have 
used it in the past. 

OJEs don't , or shouldn't, just happen. 
OJEs need to be carefully planned, and tailored 
to the person. This is the benefit of the 
vocational evaluation - psychometrics and 
worksamples - prior to an OJE placement The 
evaluation data, including behavioral, gives clear 
indications of potential trouble areas to watch, as 
well as identifying the most suitable job site for 
an OJE. This should not be underestimated 
Often we as evaluators, placement specialists, 
and rehabilitation counselors become so 
concerned with a speedy job placement, 
projected time-lines, and terminations that we 
short-change the person were trying to serve; it 
should be noted that often the client is trying to 
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' speed the process up as well, but it's our job to 
keep things in perspective. 

Como (1985b) speaks on marketing 
facility services to community employers; 1) 
ITic first and most important strategy is to 
become familiar and involved with the company 
over an extended period. An OJE site could be 
developed into an OJT or Supported Work or 
Transitional Work site. Gerber (1979) noted 
that in using OJEs, a concise and clear OJE 
report provided documented evidence of the 
chent's real work site abilities. This can be a 
good future job reference - a successful OJE. 
The report structure itself becomes critical: i.e. 
if it's not on the form, it will probably be 
ignored. So a good OJE repoitform must 
mclude no only essential elements or tasks 
nuWng-up the job, but the general behavioral 
adaptions expected of any worker. In addition, 
the form must be flexible enough to be respond 
to unexpected or unforeseen events and 
circumstances. Usually, this flexibility is 
achieved by adding a "comments" section for the 
supervisor on site. The client's comments 
regardmg the OJE should be recoixled on a daily 
basis as well to prevent conflicts and clarify the 
situation. 

Possible ways around iliis concern of 
moncy/ame might be to extend tax incentives for 
On-The- Job Training to include the OJE, and/or 
develop a separate line item for OJEs in state 
Dept of Vocational Rehabilitation programs to 
be administered and controlled by the local 
agencies. Admittedly, such steps appear to be 
remote possibilities at this time. This is an 
important area for discussion. 



Summyy 

Munstcrberg did not believe in 
psychometrics measurements of individual work 
potential. He preferred the real environment 
when possible, or a veiy good simulation of the 
exact job the person was trying to perform. My 
own bias leans towards more, rather than less, 
use of the OJE in vocational assessments. Can a 
good vocational evaluation be done without the 
use of the OJE ? Yes - under the right 
circumstances. Individual client factors 
determine the need for the use of an OJE. 
Under certain circumstances, I would find using 
tlic OJE critical. In the past, some of tliose 
reasons have included; 



1) Client fct^ certain that their ready for work, 
and can not be dissuaded. Tl)is is the time for a 
little "reality" encounter. Sounds rough, but 
facts are always easier to digest than someone 
else's suspicions. 

2) A person has a long (c.g.5 years or more) 
steady woric history, or may have no meaningful 
work history, and scores well on al) 
psychometrics and/or worksamples. They do, 
however, have a disability that negatively 
impacts on one of the Emotional/Social and/or 
Coping/Adapting factors in Dr. McCairon's 
model for successful employment. 

3) Borderline or higher level Mild MR disability 
groups with a some woric history. In addition, 
they would score well or marginally well on 
tests (compared with general rehab.client or 
special peculation norms). / lso,theMDWES 
and/or Perceptual Memory 1 est (PMT; both by 
Dr.McCarron) indicates a Transitional vocational 
level. 

4) Any person scoring at the Transitional 
vocational level or higher, but lacks social 
skills/experiences. Such persons usually have 
no work history, or a sporadic one at best 

5) Any person with a physical disability that 
requires new adaptive devices. Usually, this 
population has a large job re-training need, so 
any OJE may need to be defenned. But if 
possible an OJE closely related to their chosen 
field before their training, could yield beneficial 
data to both evaluator and client 

The OJE is alive and well at our 
rehabilitation facility, but we still have plenty of 
room to expand such a program. Our facility 
philosophy of meeting individual needs - 
individually - has meant some additional costs 
and staff time, but it's been worth it. The OJE 
is not needed in every case (e.g. clear cases of 

Adjustment or Situational Assessmentji), 
but, as Botterbusch (1978) and others have 
suggested, the OJE has been under utilized by 
vocational evaluation specialists. With more and 
more emphasis on community-based v/ork, I 
think the trends for the future arc clear - more 
OJEs. 

If you'd like additional references or 
information, please write Oi* cali me at the: 
Evaluation & Developmental Center 
Southern Illinois University aiCarbondale 
500-C So.Lcwis Lane 
Carbondalc, IL 62901 
or phone: (618)453-2331/6394 
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CONSIDERATIONS FOR JOB SELECTION AND PLACEMENT 
PERSONS WITH CUMULATIVE TRAUMA DISORDER 



CHERYL L. LOPEZ » OTR 



ABSTRACT 

Cumulative trauioa disorders are re- 
ceiving greater recognition aa compensable 
injuries. These disorders, moat commonly 
carpal tunnel syndrome^ sre highly associa- 
ted with repetitious movements of the upper 
extremities and reach epidemic proportions 
in certain hand-intensive indxistries. Cum- 
ulative trauma disorders affect more women 
than men, usually in their middle years. 
The condition often becomes chronic and a 
^-etriment to eoploysbiUty. A job change 
IS often recommended by the physician and 
therapist. Vocational rehabilitation of 
the person with a cumulative trauma diaorder 
poses a challenge as these people are often 
mxddle-aged women with few transferable 
skills. When plsnning placement, c&reful 
consideration must be given to the nature 
of the work and the presence of other 
chronic conditions with predisposing 
f actorR« 



Cumulative trauma disorders, also 
referred to as repetitive trauma dis- 
orders, can be defined as a category of 
phyoical signs and symptoms involving 
the muscles, nerves, tendons, arteries 
or bones of an extremity as the result 
of chronic musculoskeletal strain that 
appears to be related to repetitive 
work activities (Puta-Anderson, 1988). 

The existence of such disorders 
and their relationship to work activities 
dates back to more than 200 years ago 
when an Italian physician, Bernardo 
RamazEini, noted that the character of 
materials being handled and "certain 
violent and irregular motions and 
unnatural postures of the body..." 
seemed to lead to the gradual develop- 
ment of serious diseases (Ramazzini, 
1717 and 1940, cited in Putz-Anderson, 
1988). The frequent relationship be- 
tween certain occupationa and a par- 
ticular disorder can be aeen in the 
names of such syndromes as gamekeeper's 
thumb, carpenter's elbow, and atitcher's 
wrist. However, despite such historical 
evidence of the relationship between 
the nature of work and certain physical 
disorders of the extremities the recog- 
nition and acceptance of cumulative 
trauma disorders as work-related, hence 
compensable, injuries is relatively new, 
and in fact, may vary from state to state. 

The reason for this increased recog- 
nition of and attention to cumulative 
trauma disorders as work-relsted injuries 
is multifactorial. First, the 08HA General 
Duty Clause, Section 5 (a), requires each 
employer to provide a work environment 
that is free from recognized hazards that 
are likely to cause serious harm (Occupa- 
tional Safety and Health Act ol 1970). 
While there is no ergonomic standard for 
cumulative trauma disorders under this 
clause, 08HA does recognize "ergonomics 
worker injury and illnesses" as serious 
hazards (Conley, 1988). One well publi- 
cized example of OFHA^s activities in 
this area is a A. 33 million dollar fine 
levied against the John Morrell Meat 
Packing Company of South Dakota in 1988 
for failure to correct conditions 
relevant to carpal tunnel syndrome. 

Second, public awareness is on the 
rise. As OSHA incr/jafles its efforts to 
uncover and correct ergonomics hazards, 
labor unions are also becoming involved 
by exerting pressure on employers and 
educating their members. Also, it is not 
unusual to see articles about carpal 
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tunnel syndrome in daily newspapers and 
magazines such as BusinessWeek. As a re- 
habilitation professional, the author is 
seeing more and more clients who are aware 
of crtrpal tunnel syndrome and its link to 
their work place. There is a growing re- 
luctance to accept chronic aches and pains 
as part and parcel of a given occupation. 

Thirdi in some industries the pre" 
valence of cumulative trauma disorders 
such as carpal tunnel syndrome are epidemic 
in proportion and are a major source for 
lost work timet medical expenditure and 
compensatory payments (Armstrong, 1986; 
Finkel, 1963; Maeser et. al., 1966). 
Some examples of industries with high 
prevalence of cumulative trauma disorders 
are meat and poultry packing, small as-* 
semhly work, auto assemblyi and checkstand 
and key punch operators (Putt-Anderson, 1986; 
Armstrong et. al., 1962; Finkel, 1965; 
Feldnan et. al., 1963; Birbeck and Beer, 
1975). 

One common denominator for these 
seemingly diverse occupations is the 
repetitive nature of the work. This 
repet itiveness often combines with force- 
fulness, awkward postures, and intense 
pacing to produce high-risk factors for 
the development of cumulative trauma 
disorders (Pute--Anderson , 1966; 
Silverstein, 1968; Armstrong, 1966). 
Another common factor among these 
industries is the hand-intensivenesr 
of the work. Certain anatomical 
•tructurcai especially in the 
upper extremity, are particularly 
vulnerable to the stresses of re- 
petitive use (Blair, 1966; Armstrong, 
1986; Feldman et. al. , '963). 

Repetition, force, posture and 
the vork/rest cycle are well documented 
risk-factors for the development of 
a variety of cumulative trauma dis- 
orders (Futz-Anderson, 1966; Silverstein, 
1968; Armstrong, 1966). Repetition 
can be defined as the number of move- 
ments required to complete a task 
(Puta-AntJerson, 1968). Highly 
repetitive tasks require repeated, 
excessive use of specific muscle 
groups often resulting in fatigue, 
strain and tendonitis. High repe- 
tition is a frequently cited cause 
of carpal tunnel syndrome. 

Force can be separated into 
external and internal components. 
External forces, or mechanical 
stresses, are those that are cxerLed 
onto the skin and underlying soft 
tissues by the tools and materials 
being handled* Internal forces are 
those exerted by muscles onto bones 
via tendons. 

The effects of internal forces 
are dependent upon the strength of the 
worker, the requirements of the task 
and the way in which the tni;k is per-- 
formed ( Putz-Andnrson, 1988; Armstrong 
and Chaffin, 1979). 



Work postures pose a risk when 
they are awkward, sustained or require 
extrome joint mof:ion. Awkward postures 
can affect strength by reducing the 
mechanical advantage of otherwise 
powerful muscle groups. 

Sustained postures require high 
energy expenditure often leading to 
fatigue and strein. F.xtreme move- 
ments or positioning of joints, 
especially at the wrist and shoulder, 
can result in stretching or compression 
of peripheral nerves and arteries, 
ligament strain and tendonitis (Feldman et. 
al., 1983. Armstrong & Chaffin, 1979; 
Armstrong, 1966; Birbeck & Beer, 1975). 

The work/rest cycle can be a critical 
factor in the development of cumulative 
trauma disorders. When there is an 
insufficient interval of rest or recovery 
time following periods of intense use 
fatigue and strain are likely to develop 
(Putz-Anderson, If 68), 

Generally, it is a combination of all 
these factors that culminates in a chronic 
and, ct times, incapacitating condition 
such as carpal tunnel syndrome. And, 
thest occupational factors are further 
compounded by personal attributes and 
predispositions. 

Age, gender, body composition and 
medical history also play a role. The 
typical client with cumulative trauma 
disorder is a woman in her AO's, low- 
akilled, and working in a low-paid 
assembly job (Finkel, 1985; DeHaan and 
Wilson, 1989), Average time on the job 
ranges from 5 to 9 years. This client's 
experience ia often limited to assembly- 
type work and she frequently has held 
only one job. 

The typical client also usually suffers 
from more than one type of disorder, i.e.; 
tendonitis and carpal tunnel syndrome, 
has reached a state of chronicity and 
has undergone multiple episodes of 
conservative, surgical and/or rehabili 
-tiitive treatment with limited success. 
In n'lny cases, the physician and therapist 
have recommended an occupational change. 
However, such a change is not often 
possible for a client such as this who 
must continue to provide financial support 
for herself, and in s^me instances, s 
family. 

Usually, the client chooses to remain 
at her current job which oily continues to 
exacerbate her condition. But in time, 
excessive absent eei sm, medical trea tmen t 
and inability to meet unrestricted job 
demands can lead to termination of 
employment. Even if the client chooses 
to quit, her options for alternative 
employment are :)ften limited by lack of 
transferable skills. 

Furthermore, with nn extensive history 
of cumulative trauma dioorders, she may be 
perceived as a liabillty*-r iak by potential 
employers, particularly if the work is of 
the same repetitive nature. Without 
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retraining the dilemma this client faces 
unemployraent verses continued inappropriate 
employment. The problem faced by medical 
and vocational rehabilitation professionals 
then is: How to circumvent the non*-workor 
or victim role and assist the client with 
securing more appropriate employment. 

A referral to a VDcati.onal rehabilitation 
agency seems most appropriate. However, 
determining eligibility can be complicated, 
iarticularly if the client is presently 
employed. Documentation of a cumulative 
txauroa disorder as a vocational handicap 
can be greatly assisted by thorough 
medical and rehabilitation records. A 
physical capacity assessment documenting 
tol'-ronces and symptomatic responsrs to 
repetitive work is recommende<. 

Assuming eligibility has been deter- 
mined and interes^♦. and aptitudes have been 
identified, each potential occupational 
chojce roust then be evaluated for the 
presence of the previously defined 
occupational risk-factors in order to 
ensure the most appropriate placement 
of the client with cumulative trauma 
disorders • 

The degree of x epetit ivenea s can be 
assessed by first identifying the work 
cycle. An example of a work cycle in an nuto 
asHembly plant is as follows: Lifts template 
from work bench, carries to assembly line, 
places template on the auto frame, grasps 
drill, drills 4 holes, releases drill, 
removes template, carries template back to 
work bench. Timing the entire work cycle and 
the amount of time spent on each sequence 
will reveal the required frequency of 
movements and the potential for mccular 
fatigue and strain (Putt-Anderson, 1988). 
There are no set guidelines for defining the 
degree of repetition as either high Or low. 
However, Armstrong, Fine and Silverstein 
(1985, cited in Putt-Anderaon, 1988) 
developed a procedure to categorise jobs as 
follows : 

Li2K repetitive j ob a: The overall 
cycle time is more than 30 seconds 
or less than 50Z of the cycle time 
is spent performing the same type 
of movement. 

ILuh JLftVetitive joba: The over- 
all cycle time is less than 30 
seconds or more than 50% of the 
cycle time is spent performing 
the same type of movement. 

While acceptable or safe limits for 
exposure to repetition have yet tn be 
defined, the correlation between repe- 
tition and cumulative trauma disorders 
hafl been well i«stabli«hed. Tlius, it is 
best to steer thoae clients with cumulat- 
ive trauma disorderB away ftor.i work 
falling within the high repetitive cate- 
gory. 



Force requirements, both external 
nnd internal, of a particubir job are also 
critical factors. Internal force, or 
muscular exertion, requirements are ditf- 
icult to measure liitbout without special 
equipment. But, a good idea of how much 
strength exertion is required can be 
obtained by observing work performance and by 
asking workers for their perceptions. If 
workers are observed attempting to maximize 
their leverage or putting body weight into a 
task a judgment of high force requirements is 
justified. A consensus of perceived high 
exertion by workers is also good reason to 
suspect high force is required. Also, 
consider the degree of static work involved. 
Static work, or the maintenance* of a 
prolonged position, requires much greater 
muscular effort and recovery time and can 
lead to or exacerbate joint degeneration 
(Putz-Anderson, 1988). External forces that 
are exerted onto body tissues are more 
readily apparent. These include the size and 
shape of tool handles and the properties of 
materials being handled. Frequent contact 
with hard, sharp edges, use of hand t ols 
that are inappropriately sized and the use of 
power tools that vibrate or have triggering 
raechnnisms can stress nerves, arteries and 
tendons in the hand and should be limited by 
persons with cumulative trauma disorders. 
Tools can also adversely affect internal 
force requirements and may contribute to task 
repetitiveness. 

Assessment of the combination of 
repetition and force requirements is also 
recommended. Highly repetitive tasks 
requiring high force exertions present a 
greater risk for tendonitis ( Putz-Anderson 
1988). A general guideline for the degree 
of risk posed by repetition plus force from 
least to most is : 

Low repetition, low force. 
Low repetition, high force. 
High repetition, low force. 
High repetition, high force. 

Work postures should be evaluated 
for their effect on muscular strength 
and endurance and for their potential 
to exert excessive stretching or com- 
prensive forces on nerves, arteries and 
joint structures. Postures with detri- 
mental effects include av.kward or extreme 
positioning of the wrist or shoulder re- 
petitive twisting with the elbow extended 
and repetitive or sustained overhead 
reaching. The type of hand grasp used 
is also important. Tasks that require use of 
a pinch or precision grasp are highly 
correlated to carpal tunnel syndrome and 
tendonitis about the thumb, and therefore, 
are best avoided by persons with known tendon 
disorders. Some work postures are induced by 
work station layout or work techniques. Thus, 
when evaluaning an occupational choice for 
high-'risk work postures, consider the 
potential for modifications as well. 
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Does the comi)flny have a cumuleriv? 
trauma prevention and control program? How 
is productivity measured, are there 

routinely quotas or deadlines no mvt that 
may require speed of performance? How much 
autorion^ is there to arrange cue's own work 
station and to utilise one'e own work 
tachniquea? Favorable resp )nse8 to these 
questions may mean minimized risks for 
relapse or subsequent problems for the client 
with cumulative trauma disorders* 

Finally, the roedica' history of the 
client must be examined for the presence of 
other predisposing conditions such as 
rheumatoid arthritis, diabetes, or other 
endocrine disordera. These types of 
disorders often weaken joint structures or 
alter body fluid retention resulting in a 
greater tendency toward tendonitis, 
tenosynovitis or nerve compression syndromes. 
In fact, clients who have reached a chronic 
state and are candidates for an occupational 
adjuotment often present with multiple 
diagnoses such as carpal tunnel syndrome and 
DeQuervain^s disease (tenosynovitis of the 
thumb, extensor and abductor). 

In ouramary> awareness of cumulative 
trauma disorders bs work related injuries i« 
increasing and in cc^rtain industries they are 
epidemic in proportion* Common factors for 
those diverse industries include the 
repetitive and hand intensive nature of the 
work. Along with repetitiveness , force » work 
postures and the work/rest cycle have been 
well documented as high risk factors for the 
development of cumulative trauma disorders* 

Fcrnonal attributes such gender, age 
and other medical conditions also play a 
role. The typical client emerges as a 
middle-aged vowan who is eosentially 
unskilled and workit»g in a low paid assembly 
job. 

Due to the chronic status of this 
client's condition^ physicians and therapists 
often rftcomraend an occupational change. 
Vocntional r ohabiUtat ior. of uuch a clicut in 
complex but can be greatly assisted by 
tho^rough documentation of repetitive work 
tolerances and symptomatic responses. ^ 
Selection of appropriate training or job 
placement for the client with cumulative 
trauma disorder* requires careful txnmination 
and analysis of occupational and peraonal 
risk factors. 

Trte work/>:«»t eye It encompasjieB the 
length of the work day and wftt^ln and the spce.d 
or pace of the job. It is rttcommendtitl chat 
potential occupstioris be r^ft-atched ^:or 
trends in nontradir.ional worlr.-Wi-.aks v 
routine overtime requirement a before training 
or placement commences. Exceoaive work hourc 
without sufficiont rest can exacerbate 
«xist).ng conditions by alitninatiiig needed 
recovwry timi?. A poiuoii with s cumu.Utive 
trauma diuordor may be ablt^ to tc.'Aerute on 3 
hour day wut ^vKperi enc c iucapoc i 1:0 tin^ 
sywptoti\& if required to work 10 o** 12 hours a 
day on a r^^Bul5r basie* 



Each of theae Occupational risk-factors 
exist in varying degrees throughout many 
typea of indust riea # However, as previously 
noted, certain industrieG have documented 
high prevalence rates. When selecting 
potential occupations or training programs 
for clients with a hist )ry of cumulative 
trauma disorder it ia advisable to steer away 
from these industries. Additionally, there 
will be variance from company to company 
within a given industry. Therefore, when 
considering placement with a particular 
employer there are three more factors that 
can be explored. 
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ABSTRACT 

Private sector for profit rehabilitaticai has 
grown logarithmically ftcm it's beginnings in the 
early i970»s to becane a major thrust in the 
American health care industry- With that growth 
has followed a conooroitant increase in the 
opportunities for the practice of vocational 
evaluation in the private sector, particularly in 

SSJtS^i'^^^."'^ Paperlaresents a maaal of 
vocational •valuation swn^ioe dalivaty in the 
private sector based on the tecSinigues developed 
the author in his private practice, step by 
Btep instructions and considerations are provided 
tor those considering developing such a pSctioe. 
Soros of those considerations iivsluded are: working 
professionals; credentialsT 
establishing a fee; billir^; and marketing, ihe 
paper ends with a brief discussion of ithS 
emerging private practice markets. 



Vocational rehabilitation has largely been a 
government run service in America since the 
inoqrt:ion of the State-Federal Vocational 
Rehabilitation program th^^rxi^ federal legislation 
in 1920. While that program has reached level 
grof/th in the last decade, there has been an 
e>q)losion in the for-profit sector of 
rehabilitation from nothing in 1970 to nearly 
1,000 ocnpanies by 1982 with total annual 
revenues approaching $250 million (Lauterbadi, 
1982). Kaiser and Birown (1988) pointed out that 
private for^Mcof it rehabilitation has been built 
around the vocational rdiabilitation needs of 
the industrially injured which has absorbed 
increasing amounts of our federal health 
expenditures. For exanple, Power (1984) estimated 
that in the past decade, insurance ocRfsanies have 
spent billions of dollars in enployee benefits 
including vocational rehabilitation due 
to cn-the-job injuries. ihe numbers of 
injured workers are equally staggerir^ as the 
Public Health Service (1972) reported that 
400,000 new cases of occupational disease are 
r^rtad annually and more recently in 1986, 
the aireau of Labor Statistics reported the 
number of workplace Injuries and illness 
averaged 7.9 workers per loo per year which 
totaled 5.6 million people. These numbers have 
pjxjvided fertile ground for the development of 
private practice rehabilitation. 



Randall McDanio] ,Bd.D. ,OIR,CVE is an Associatia 
Professor in the Rehabilitation aM Special 
Education D^>artment at Auburn university in 
Alabama and fourder of McDaniel arri Associat -3 a 
private practi(x> vocational evaluation firm 
specializing in vocational rehabilitation 
testijnftony. 



Services 

Vocational rdiabilitation professionals 
moving into the private sector in the early 
:970»s took their roots of public service 
practice methods but provided increased effort 
in job placement as was needed by the insurance 
coipanies funding the worker •s compensation system 
for Jjnjured workers . Many of those early 
practiticaiers were rehabilitation jounselor 
trained and tended to minimize their efforts 
in assessment and concentrate on casework. Some 
few had worked as vocaticml experts for the 
Social Security Administration and found the 
concept of transferable skills as used by Social 
Security useful as a model for oourtixxm 
testimony as vocational ejqjerts. 

As the private-for-profit field has grown, 
cas^rk oriented practitioners have recognized 
t)ie need for an increased eirphMis on assessment 
resulting in the development of firms which 
only provide vocational evaluation services 
to ind^ndently enplcyed rehabilitation 
specialist and for casework oriented private firms 
to increasingly incorporate vocational evaluation 
into their service oarfonent. Therefore, a role 
has developed along traditional lines for 
vocational evaluators who have transported 
their skills to a different market. This has 
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resulted in vcx^ational evaluators not only 
broadening their base, but also modifying their 
service and techniques and moving into new areas 
of practice where their services have been found 
of benefit, most notioeably as related to the 
legal systean. It is then possible to utilize 
assessment skills priinarily in forensic 
vocational evaluation to determine the eff6c± of 
the injury or illness on the worker's 
vocational functio^dng and to determine future 
injury incurred costs, VocatiOTal evaluation in 
the legal settii^ therefore has been used 
to: assist in the determination of disability 
tor social security; determine vocational 
lirpainnent ratlngsln workers oorpensation 
disputes; determine diminution of earnings 
in personal injury litigati<»i; and^ provide 
rehabilitation plans in life care planning for the 
catastrqphlcally disabled* 

Practitioners in this arena are typically 
labeled Vocational Experts by the courts but are 
also variously kncwn as Rehabilitation 
Specialist, Rehabilitation Experts, and 
Vocational Rrtiabilitatlon Experts. Ihe key 
however, is that to the lay population, the 
practitioner is expert in the knowledge 
of jobe and rehabilitaticxi. 

Social Security Hearings ecnd Pippeals 

Under Social Security regulations, a person 
with adequate socicd security coverage, i.e. a 
worker has paid into the systan for a 
specific number of quarters, can receive 
social security payments and^or supf Isnontal 
security inoome if they beccme too disabled 
to work. Ihe Social Security Administration has 
developed a grid which matciies injury/illness to 
worker age, education, and job history to 
automatically determine who is eligible. However, 
a person who is turned down for disability can 
appeal that decision until ultimately, they are 
given a hearing before a judge in the Bureau of 
Hearings and Appeals. The judges at their 
discretion can call i^xxi medical or vocational 

experts to sit in on the hearings and testify in' 
their ^>eciality on the claimants background and 
potential possibilities. 

For the vocational e>^)ert, the process 
involves reviewing claimant files without seeing 
the person until the hearing. Ihe hearing consists 
of the judge and the claimant's 

r^resentative questioning the claimant in 
order to hi^i^t the problems and credibility 
of the claimant. The vocational expert is 
asked to cheuracterize the claimants previous jcte 
based on their physical demands, skill levels, 
and to discuss any transferable skills 
possessed by the claimant. The judge then 
structures several hypotheticals in which 
the claimant's case is presented with varying 
degrees of restrictions and the vocational expert 
is asked what jobs exist that the claimant could 
perfom) taking into account their age, 
education, previous jobs, transferable skills 
and listed restrictions. If jobs are identified 
by the vocational expert, tlien they are 
required to provide information on the nuiriber of 
those jobs which exist in the area of the 
claimants residence. Vocational expexts in 



this setting are utilized in ^ high percentage of 
cases to review unskilled workers who liave 
injuries which restrict t aem to 1 ight or 
sedentary jobs. After the presentation of 
the vocationed e)5)a:t in response to the 
j udge ' s hypotheticals , the claimant » s 
r^resentative and with some judges, the claimant, 
have the opportunity to cross exam the vocational 
expert. 

In order to perform this job, a prospective 
vocational e^qpert has to apply to and be accepted 
by the Social Security Administration in 
Baltimore, Maryland. It is advisable however, to 
visit the Judge in diarge of the regional 
Hearings and Appeals office and gain their 
backing. They will be interested in the 
training and experience background of 
potent ietl applicants and they seem 
particularly impressed with graduate degrees 
and a history of placing injured workers. 
Current vocational e^^serts with Sociad Security 
are iisually asked for reoonmendations when 
openings occur in a local office so that another 
route to this vrork is to get to know these 
people and ask for a reoomoendaticm. 



Vocational Impairment Ratings 



Worker's ccnpensation legislation was 
established at the beginning of the twentieth 
century in order to prevent enpipyees f ran making 
le^ claims against employers for medical and 
si^sport benefits needed after workplace 
injuries and Illnesses. Workers ccnpensation 
is determined by state legislation and 
Therefore coverage and benefits vary between 
states however, the state law defines who must be 
covered and the limits of coverage. The coverage 
is supplied by insurance ccnpanies who write 
workman's ccnpensation policies or it can be 
done through self insurance which is done by 
large ocR{>anies. When an individual ii disabled on 
the job, they are required to turn in an 
accident re^port and the insurance oonpany is 
responsible for the medical cost resultiixr from 
that injury or illness and for offsetting the lost 
W(K(es. If a person is totally and permanently 
dJ.sabled, the insurance conpany is usually 
rp^quired to pay all medically related cost and a 
lifetime weekly wage. That weekly wage can be 66% 
of the person's won wage tp to a maximum 
weekly amount. The insurance oonpany cjan pay the 
person in regular payments or in riost states, 
has the opticn to settle with the person for an 
agreed upon lunp sum of money. 

For the person who is tenporarily disabled, 
they generally receive medical payments and a 
wage offset for the period of time they are 
off work. That is terminated v^en they resume 
work and are considered healed . The most 
confusing cases to deal with are those 
considered permanent partial disability for which 
the insurance ccttpany is responsible for 
paying medical bene! its and some salary 
supplement, in this instance, the injured worker, 
court, and insurance oorrpany need assistance in 
determining the degree or percent of disability 
from which they can base a settlement . Ihe 
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vocational portion of the settlement is 
?^T^ J'l "^^itiplyii^ the percentage of 
inpairtnent by the amount of money which wcold be 
paida permanenUy disabled worker for wage 

ii SL?^*^ Sf'™ °^ weeks the person 

is eligible if there is a limit. 

f^' ^® iiipairment was determiiitd 
frcin a inedical percentage of disability assigned 
by a physician. However, camonly a medically 
^^f^ loss which is considered a 
small percentage to the person's body as a whole 
can be devastatiiig to the person's chances of 
eianple, an illiterate tiirtoer cutter 
over forty years of age who is limited to a 
lifting restriction of 20# jnaximum f rx«n a back 
^u^y receive a 15%i^cS^irS ?aSS 
?Mn^2«^ Ottered a setUement 

IrSnn ^ octipany^ of aoproxlmately 

P«»°9 "ay be severely SScationSl^ 
iJ^ired «nd receive a vocational ImjairSent 
SJJ^L.^ 5^ would entiSr STirr 

f ^ the same guidSinS. 
for tSLtJSS^>r^^^°^ i^ipaiSnent ratings 

, to calculate the 

SSfSf l.fi"*?i^' percentage. ihis J2 
therefore left roan lor both injured worker 

^SrtT^^i?^. ^'^^ ^ vSStiona? 
Exerts utilize age, education, previous woric 
history, test data, and physical r^riSSTto 
SJf™^f,P^tage Of loss Of access S^tS 
Ijbor njurtet and percentage of expected wagTlos? 
ihey nay also factor in ^love^ 

SSiiai^. *»ta in arriving at 

In this process, the vocational excert 1«5 

vocational impairment rating. Results of Se 
evaluation are given to that attotT^e/ «ho will 
determine if they are helpful to c2^. if 

so, the results are oomnunicated to the other 
side who may schedule a discovery deposition to 
det^ what the vocational IWt win say S 
court, i.e. their method of arriving at 
their findings, and the potential credibUity of 
the expert to the juJge. ihe vocational e^^'^r^y 
have their results utilized by the two sides in 
ineachijiga settlement or may app2r in ^SrT 
generally circuit court, fSTJ iLT^ 
^luation their testimony alor^ wi^h othS 
testimony agaiiTst the law to reach a 
determination. Approximately, ninety percent of 
cas^ are resolved before goi^ toSurt 
depending on the attorney. 'J ^ ocurc 

Diminution of Earnings 

ai^ iSh?^^ f^^T^^^^ n«"ufacturers 
are liable for defective prtxJucts which injury 
people particularly if negligence can be 
demonstrated. Negligence also plays a oart 
^ the liability of prx)fes3ion^ls such ^ 
physicians who injure their patients, m those 
types Of litigation, the case has two parts 
I.e. the determination of liability and s«x3ndly' 



the determination of damages. Vocational 
ejiperts are utilized by the legal system in 
this situation to determine vocaticaial damages in 
the form of loss of wage income, i.e. diminution 
of earnings, in this situation, the vocational 
expert determines the persai's pre-injury wage 
and projects their post-injury wage potential. 
If the post-injury wage is less, that data can be 
used to determine the person's total loss of 
inccme in their expected lifetime to arrive at a 
total sum of mon^ which the injury cost due to a 
reduction in wage. 

Vocational evaluators undertaking this work 
can oqject to work with disabled adults down to 
infants. If the injured person is younger and 
has not reached their career maturity, then the 
vocational expert is required to project 
their potential pre-injury average wage based on 
fam..ly e>qjectation and average worker data. Post. 
inDuiy wages can be determined utilizing the 
r^JTictiona inpoeed by the injury to determine 
post-inDury potential jobs and secondly, the wage 
rate, in this case, wa«.jes are averaged acrtsss 
numerous realistic job possibilities. 

Vocational experts are utilized by attomeys 
^ feel tliey can sell a judge, jury, and the 
other side on the qualifications of the 
vocational expert whidi tend to be a 
ccmtainaticn of vocational rehabilitation 
education and ei^jerience. There ar. several 
standard defenses against the testimcMry of 
^^S^ iiicluding challengii^ the 
CTedibUity of the expert through an attack on 
their credentials. Of interest is the problem of 
oyer exposure of the expert in the court as a 
witness too many times for one side or the other 
at which point, the expert loses credibility. 
In this instance, a person can literally vAark 
themselves out of a job. 



Life Care Planning 

^ . ^ , relatively new area of forensic 
rehabilitation practice vAiLch vocatiwva 
evaluators are discovering is concerned with Life 
Care Planning, in the situation where damages 
are being ccrnuted, a rehabilitation expert is 
in the positicn to determine the other than 
vocational cost to the injur«i party as a result 
of the negligence or malpractice. yuch costs 
whidi can be considered include psychological 
counselitig, physical or occupational therapy 
future surttery or medical expenset needed 
medical equijment, drug expense, special care 
facility expense, tutoring, household 
modifications, attendant care, van/auto 
modifications, special education, vocational 
evaluations, or any of the other multiple 
service, equipment, and materials cost 
associated with a catastrophical injury. In this 
instance, a vocational evaluator can serve as 
part of a team working on such a document or can 
prepare the entire report if they have a bread 
backgmind in medical and vocational 
rehabilitation. ^^.j-orwi 

With any of these service areas, the 
vocational evaluutor is in position to take on Uie 
role of vocational expert in the court if 
he/she has appropriate education and experience 
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and is willing to undergo the stresses inposed by 
this area of practice. To actually do this 
job requires the use of a nxxlel of services 
which congresses the public sector evaluation 
inodel but follows inuch of the same procedures. 



MXAXIONAL EXPERT MXEXi OF SERVIOIS 

The vocaticml e}qpert model of services in 
Figure 1 presents the five steps perfomed by a 
vocational evaluator in carrying out a 
forensic vocational valuation. It begins with 
a review of pertinent background infozmation. 
Of particular interest in that review are 
reporta or dqpoaiticns which provide specific 
infomatlon on physical or mental restrictions 
which are iofxaaed \Jpon the injured worker by the 
illness or Injury. For exanple, it is necessary to 
understand that a person is restricted in bending 
and stooping or wox^dng around fumes or heat, if 
this information is not readily available, it may 
have to be specifically requested fron the 
treating practitioners or gathered from a new 
evaluation audi as a physical capacity 
evaluation before the vocational results can 
be tabulated. Secondly, information on the 
worker's former enployment such as in a 
personnel manual job description or a job 
ansdysis of the customary work is invaluable to 
the vocational evaluator, lastly, informatics 
about the wage history, customarily in the form 
of ixKxma tax returns is of assistance in 
oon|Xitingr wage loss. 

The second st^ Involves meeting with tlie 
injured vrorker for an interview to develcp a 
detailed personal, educational, and work 
history and gain their perspective on their 
injury and it's Jirposed limitations. l»*e 
credibility of the injured worker is always in 
question in ocurt in that they have a monetary 
gain by appearing incapacitated so that it is 
beet to understand their porapective on their 
Injury text develop restrictions based on a third 
party aesesmsnt. Sinoe the vocational 
evaluator will be testifying as a vocational 
expert, sairphasis In the Interview should be given 
to gathering the data about the vocational 
background Including the order of the jobs in the 
work history, the exact p/pe of work done, the 
physical demands of the job as they perform9d it, 
the pay reoeived, and the dates worked on the 
various jobs, m later r^rting this 
information, the vocational expert can terrper the 
reported description of the jobs with 
their resource descriptions of those jobs as 
they are custcmarily performed in the national 
economy. 

Follcwing the inteirview, testing is generally 
done to clarify the level of functioning of the 
injured worker to oarpare it with expected 
skills from their previous enployment. An 
additional reason to test is to give the evaluator 
an opportunity to observe responses of the 
injured worker to ttie test situation vAietJier the 
test are mental or physical, it is prudent to 
begin testing with a good reading and mth 
assessment which will have a bearing on 
current ability, possible future training, ' and 
on the capacity of the testae to \andergo 



additional tests which may require a minimum 
reading level. Follcwing that determination, the 
next order of test to consider are aptitude test 
to provide a clearer picture of present 
functioning which can be conpared with 
Department of Labor data on the worker's previous 
jobs. In other eureas of practices, vocational 
evaluators have been advised to customize their 
testing approach to the individual however, in 
forensic assessment, it is best to have several 
standard tests which would be of a usual and 
customary nature in " jcational evaluatiOT to 
demoistrate to the court that this evaluation 
meets the standards of the field. Further 
testing beyond the aptitude tests are not 
generally required however, their use should be 
determined by individual needs such as interest 
testing if working with a person ^o will have to 
change fields of work, i*iysical capacity testing 
to verify llmitatlOTS, or work saitples on 
specific job areas to determine present Gkill 
or physical capacity levels for that job. 

In analyzing the results of the background 
review, interview, and testing, the evaluator has 
to depend on resources which provide Information 
on jobs such as job desoripticxis, job families, 
aptitude levels, strength and physical 
demand levels, educational levels, envircranental 
factors, and relationship with data, people, and 
thirsgs. Ihese sources are used in better 
understanding the oonpiexity and demands of the 
former jobs and in performing transferability 
of skills analyses. While this Information can 
be retrieved by hand from a library of 
ooa?)ational information, it is time saving and 
thus cost effective to utilize oonputer programs 
v^iich contain this data. Further, determining a 
loss of access to the total pool of j obs 
availa^ue in an Individual *s labor market is 
tedious and not inclusive in using hand itcthods 
and virtually demands conpaterized 

assessment. 

The last phase of the model for services 
requires that the evaluator communicate their 
process and the evaluatic^i results in a 
meaningful way to an appropriate source. It is at 
this point that the skill of the vocational 
evaluator in cleeurly corrounicating to an 
uninformed or lay audience will distinguish 
those that can sucxi^ed in tills practice from 
those that will not. The perscu referring the 
injui*ed person will be the immediate recipient of 
the information developed by the vocational 
svaluator. Ihis information is then shared with 
attorney *s for the other side, the insuramce 
coitpany, and the injured party. Evaluation 
results can be shared in short summary letters, 
long and detailed reports, depositions, or in 
oourc appearance. The referring agent will 
generally specify the purpose of the assessment 
and if given a choice will have a desire for the 
metliod of cximunicating the results. For 
worker * s oarpensation cases , a majority will 
only need the evaluation results containing a 
vocational impairment ratii-g to effect a 
settlement • Quite a few will go on to 
require a discovery deposition by the other side 
and of those, a few will require a court 
appearance . Of the personal injury cases in 
litigation, many will settle before a court 
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appearance is required but a higher percentagn 
wili. require testifying in court. It can not be 
too hic^y stressed tJiat the skill of the 
evaluator at cxwimuilcating in those situations 
13 of paramount i^iportance to their 
effectiveness. 

r^y^^^J^il!^ section, considerations arB 
present«l which must be delt with in setting un 
?f.i°T'^° vocational evaluation pStice 
Items discussed include workijig with other 
professionals, evaluator credentials, establishi.m 
a fee, billing, and marketing. 



ocNsnxnmctG 

In moving into this area of practice, a 

need to be made in 
order to effectively prwide the service and 
^Jf^ additional referrals. Ohe following 
discussion will briefly provide an overviS 
of those considerations. overview 

Working With Other Professions 

««.i„5 ^^,f°^ic vocational evaluation, the 
evaluator will frequently be in contact with 
oth^ professional workers and will be in the 
V^ nT S."^.*^ receive referrals frtm thm. 
tony of the fellow professional workers are in 
the same team role as in other settings however a 
few new players are encountered. The first duty 

Hf,!5L!y*-^"**°'^ ^ ^ «^ reports, findings, 
Jk^u^" «ork, and treatme^ plans t^. 

S^..?""*" Medical and^ 

SLfn«S°^' , Psychological assessment' 
am treatment plans, physical/occupational 

^^L^'^^^^l^^'^'^ capacitilXtSS 
are ooninonly review«l by the evaluator. In this 

work of the evaluator is the same 

SLt^^iJf ^^^i!!! ^ exception 

i^jy^""^^ need .o be aware of their 

interpret findings from other professionals. 
r«n«>2S "ferrals ara received by attorney's 
representing one side or the other. Those 
representing the person who initiate ?K 
ii^^S^i^ (generally the injured worker) an. 
designated plaintiff attorneys and thSe 
representing the party being Led (generaJ^ 
the insurance oatpany) are known as defens^ 
t^^S^^' ^ vocational experts if 

think the expert can help in the preparation of 
^C"^ plaintiff 
l^^r ^re often than defense 

attomeys. -ihe role of the attorney is to 
represent their client as best they can to win the 
case for their client and they will uSlLe Sy 
technique legally possible to prwide that win. 
or interest to the person njM to this setting is 
SSm-^^MfT ^"^^ht to ar^e or defend 

^ " ^^1^ one might appear 

SnSSi.^?^^^*^^ ^ vocational expeftS 
deposiUons or court, the vocational expert may 

^"^^^^ did a gocd jci,. In ither 
i^;^..?* attorney's arguments and techniques 
are often more in the li^ of doing the lob San 

eLrt '^^^.E^L'*"^^^ the vocational 

e}«peit. Attorney knowledge of vocational 



^iS*^."".. ^ nothing to 

sophistication depending on the number of times 

''L "^f ^^^^t ^°^ne from this 
field. Ihe attoiney's - ole calls for them to be 
ej?«xt on the law and x:o learn enough about the 
^ u involved to ask good questions 

to help make their case. In preparing their case, 
attorneys are required to outline the basic 
course of their plans for the case to the other 
side so that that side can prepare itself, m 
that process, they are required to list the 
ej^erts th^ intend to utilize and the attorneys 
L.^® 5^®^. an opportunity to 

conduct a deposition to determine what the expert 
iJitenas to s-y in court, in the deposition or in 

Sit Zt/^yJ^^tu^^, questioning of the 
exptrt and the other side will have the 
OFpor-.;.Tity to ask questions next. Following 

cross-examination, they cS 
^^^^ attorneys for'boST^iS 
are satiafied. ihe attorney who feels the 
^^arthaii aided hlB case will want to luild\^ 
the credentials and techniques utilized by tS 

and the other attorney will try to not allow 
testitony or discredit the expert or theiT^S! 
r..^^ ^'^^^ ^case, the attorney will 
can for medical then psydiolajical expert 
y^sstimnny first to establish the naturT^ 
Uipairments and restrictions. The vocational 
is then called to establish the vocational 
impairments from iirposed medical and/or 

may be utilized to add monetary meaning to the 
Y°f^i«?fl ^ir role is to^take 

IJrformation provided J-y the vocational expert 
such as wage loss or needed services wSto 
provide a total figure of the money which will be 
lost or needed in the person's expected 

oil^^^^\^^^'^'^ professional^^ 
one which vocational experts need to keep in 

™^ ^? ^ ^ their worksij>oe 

much of it depends on the numbers provided bv the 
vocational person. With all these professionals, 
the vocational expert must understand their role 
and the oontrilwtion they are making to the 
total pictuTft and be willing to interact on a 
peer level when needed. 



Credentials 

Ihe credentials of the vocational expert 
^^T^^ establishi^ themselvesto 

judges and juries as being knowledgeable in 
their field. Ttie crodentials presented are 
^^ij '^ appropriaSnSTSf 
education and work experience possessed by 
the vocational expert however, thiTis quickS^ 
"^^'^^ °f the'expert tl Tr^t 
S'^ ^^'^'^^y^"^ crediJ^le^: 
T.f an expert projects any image other than 
honesty, their utility in c6urt Sin ^ 
shortlived. Bduration seen as aj^ropriate includS 
a mini^ master's degree in'^ a rehabiSSSS 
'rZh^^fS^ ^ vocational evaluation or 
iSSfiii? counseling. work experience in 
vocational evaluation of differ^t 
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disabled pqoolations is necessary and it 
is desirable to have had experience actually 
placing disabled workers and working with 
enplcyers. 

Adiitional crcN'^tials which will add to tlie 
vocational expert s credibility are a work 
background of referrals from both plaintiff 
ard defence attorneys, professional ijTVolvement in 
organizations, and the holding of 
appropriate certifications and licenses. 



Fee Schedules and Billing 

Ihere are two approaches in establishing 
fees for services; the reasca^able wage and the 
fair narket a^^proadi. Ihe reasonable wage 
approach suggest that a person will determine 
what it takes to earn a fair but meager living 
and add in all necessary expenses to perfonn the 
work such as travel , equiprnent, secretarial 
support, utilities, etc, This anount is then 
divided by the available work hours to derive an 
hourly fee vAiich is Aarged for all work 
ccnpleted. In the fair market eqpproach, the worker 
detentdnes what the market will bear and charges 
as iruch as possible and still gamer referrals. In 
this supply and deacnand approach, the fee is 

adjusted upward if there are anple referrals 
and adjusted downward if there are not 
sufficient referrals to maintain a full time 
practice. In sai» settings such as Social 
Security, the fee is set by the agency and it 
becomes a matter of priorities as to whether 
the vocational expert feels the fee is 
sufficient to conduct the service. 

It is possible to bill for services based on 
an hourly fee or to establish a fee per case. 
This latter method seems to be utilized more 
where there is volume work or keen ocwpetition in 
a geographical area and a typical fee Per client 
evolves. The hourly fee method is one utilized 
by attorneys so that there • is generally 
little resistance to this method of charging. The 
biggest resistance is often the vocational 
expert who has worked in public service 
backgrounds and has a difficult time charging for 
the time they actually spend on a case. 

Due to the problems in billing and cash flow, 
sotve vocational e)q5erts require a retainer to take 
on a case in whidh the referr^ ^ .attorney puts 
up an amount of money is charged 

against until exhausted. O^^ prefer to wait 

until their service is pe.-. ^ and bill for 
the service. Although it takes xonger to re^^ive 
pay for the work in this latter method, it does 
offer the advantage of not being paid until the 
service is actually done. In either instance, it 
•is in^rbant for the vocational expert to 
develop a bookke^irg and billing system to 
track expenditures, work performed, and monies 
received and owed to ke^ accurate reootxJs for 
cash flow and incctne tax purposes. Itiere are 
several good small business accounting, money 
nanagen^t, and timtibillir^g coiput^r programs 
which can assist a busy practitioner xn this 
effort. 



Marketing 

In this business, the vocational expert will 
b?. carpeting in the free market environment witli 
otirer experts and agencies offering the sme 
service. Being innovative, attending to the needs 
of th*.^ referring agent, and most ijtportantly, 
provid.'jig a quality service consi.stently are the 
keys to staying edive in this business. However, 
every person has to get started to demonstrate 
their abilities, ihis is best aoocnplished by 
marketing the service to the most likely 
referral sources. Insurance oowpanies 

which underwrite workman's ccjnpensation, pri'/ate 
r^iabilitation caseworkers, and legal firms with 
a r^xitation for handlii^ personal injury cases 
are good places to start . Armed with a 
professional resume and exanples of past work as 
deronstrated by oonpleted vocational 

evaluation r^rts, the vocational e5q)ert 
in marketing wil?. need to spend time face to face 
and sell themselves. Another place to seek 
referrals are throug(h attendance at meetings where 
referral sources oongregatr or by making 
presentations i\s to vAiat can be offered to 
professional group meetings of the referral 
sources. 

Once a few cases are done, satisfied 
attorneys or insuranoe adjusters often will tell 
their associates of this service and the 
vocational evaluator is on the way toward 
establishing a r^xitation among the referral 
sources. 



OONdUSION 

In conclusion, the private for-profit market 
has numerous opportunities for the vocational 
evaluator frcra \^wking in business and .industry to 
working in legal settings. Bie same basic 
techniques of practice are followed with the 
exception of shortening the process and 
€3j|*«u5izing monetary loss . One of the 
enjoyable differences is working more closely as 
a respected oollegue with professions not 
usually ^vxwntered by evaluators such as 
attorneys and economist. Ihere have been aitple 
opportunities for a successful practice in tl-.is 
area for the evaluator with good credentials who 
is capable of marketing themselves . Once 
entering the free market, evaluators tend to 
become entrapeneurial in realizing society's need 
for vocational expert services. Therefore, 
opportunities become apparent to practice in 
helping corporations with their hiring and 
promotion and the need is quickly seen for 
vocatic»^l iiput into the work hardening process. 
Other markets exist in alcohol aixl dnag 
treatment prograins and educational settings who 
are sometimes interested in contracting for 
services rather than hiring a full time 
person. lastly, the evaluator with skills grounded 
in measurement and testing has c^^rtunities at 
local colleges in teaching. In short; finding 

enou^ fcr a full time practice is possil^le in 
most areas if the qualified vocational 
evaluator has the spirit to look. 
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HOVME-FCR-flCFTT 
TOCanCNAL EXreRT MDOEL 

Randall McDaniel 

I. Background Review 

Purpose: To determine physical and mental fuiV^^ional levels 
and restrictions. 

Techniques: Medical r^rts, depositions, physical capacity 
evaluatiOT, income tax reconas. 

Time: 1-4 hours 

II. Interview with Injured Worker 

Purpose: To determine family, educational, vocational, 
econanic, medical and psychological history. 

Time: 1-2 hours 

III. Vocational Itesting 

Purpose:Ib determine ability levels and physical functioning 

Test Used: Reading/Math Achievement, Vocational Aptitude 
Ct>tional: Psysical Functioning, Mental Ability 

Time: .5-4 hours 

IV. Analysis 

Purpose: To develop a profile of ability change, wage 
change, additional costs and rehabilitation plans. 

Techniques: Ocmputerized Labor Market Access Ai-alysJs 
Transferribilty of Skills, Wage Kate Doter-^ 
mination. Service Determir^tion. 

Time: 2-^5 hours 

V. Recommendations 

Purpose: To cxmminicate results. 

Techniques: Short Summary Report, Comprehensive Written 
import, Deposition, Court Testij^ny 



Time: i - b hours 
l\:>tal Time: 5.5-20 hours 
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I^WMOND n. NI'i.SON. Ph.D., CVK 



Abstract 

The purpose of this paper is to provide 
practicing vocational evalu^^tors with the 
tools needed to write a marketing plan 
targeting vocational evaluation products/ 
services. The tools to be presented are a 
marketing audit, competitor's analysis chart, 
customer's need assessment, action plan, and 
follow-up tracking form. Also, recommended 
revisions to an agency's current program 
evaluation system to include documentation of 
marketing efforts is presented. The process 
of product Identification stresses a 
systematic market audit and needs assessment. 
Actual audit and survey forms ha^e been 
(tiveloped and the process is described so 
t.iat the clinician will have a working 
knowledge of marketing procedure, ^or 
implementation. This system was developed lo 
Identify the external trends as well as the 
internal strengths/weaknesses of the 
implementing agency. The authors choose to 
emphasis market survey and product 
identification aspects of marketing plan 
development. This emphasis will inspire the 
busy clinician to implement presented 
techniques to complete an effective marketing 
plan. The pending 1991 Commission of 
Accreditation of Rehabilitation Facilities 
(CARF) standards are reviewed. The procedures 
presented irclude actions needed, persons 
responsible, interagency contracts as well as 
budgetary constraints. The reader will be 
taken through a step by step procedure for 
writing the plan. In addition to the 
revision of an agency's program evaluation 
system a method of tracking marketing efforts 
is also presented. The marketing cost 
analysis and evaluation of the plan are 
defined and addressed briefly in this paper. 
This marketing plan system is a time 
efficient and :ost effective method to 
address the CARF requirements while 
effectively targeting markets available to 
vocational evaluation providers. 



IntroductiQp 

The competition for oijaniy vjcational 
evaluation services is cjntinHng to maintain 
an escalatir rate. The development of an 
agency marketing plan will Identify the tools 
needed to respond effectively to this 
escalation as well as many other issues. 
Marketing is the analysis, planning, 
implementation, and control of carefully 
formulated programs designed to bring about 
volunteer exchanges of values with target 
markets for the purpose of achieving 
organizational objectives. (Simon, Eds. 
Berkowitz/Flexner, 1981). The 1989 CARF 
standards indicate that by 1991 a marketing 
plan will be manditory for accreditated 
programs. Therefore, the procedure of 
developing a marketing plan will be presented 
Inclusive of forms to revise for 
implementation to the readers particular 
agency. 

In the past, most service providers have 
implemented a sales orientation to 
distribution of products and services. This 
orientation Involves the seller providing a 
service/product of which there is a need by a 
purchaser with the relationship being 
vertical in structure. The information flows 
only one direction from the seller to the 
purchaser. Now, a marketing orientation 
approach is needed with the purchaser and 
seller being in a linear relationship with 
critical information originating from both 
the purchaser and seller. 

Figure I 



Sales Orientation 


Marketing Orientation 


Sel ler 
Purchaser 


Seller -^-^Purchaser 



This marketing orientation challenges 
thti author of a marketing plan to 
systematically obtain information from the 
purchaser regarding his/her needs and 
expectations. This orientation also wishes 
to emphasize that internal information about 
the seller must not be overlooked if a sound 
marketing plan is to result. 

First, though, there are many external 
forces being felt by the providers of 
vocational evaluation services/products 
reflecting the trends of our profession. 
With the aging work force there is great 
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Figure II 



anli-.ipation that the disabled population 
win truly become a necessa.y resource to 
meet the nation's labor force during the next 
ten years (Brown, Ed. Fry, 1988). 

Stephen W. Thomas has presented a 
process to strategic marketing which 
establishes che theory behind this art cles 
marketing procedures. Mr. Thomas highlighted 
•■x issues in respect to marketing with tne 
first issue being "target a population . 
(Thomas, Ed. Fry, 1988). In this section, he 
indicated the worker compensation clients, 
sncial security determination claimants, ana 
special education students (Carl Perkins Act) 
are viable evaluation markets representing 
expansion of our profession. The 
occupational therapists with the r work 
hardening programs and functional capacity 
evaluation? a?e challenging the definiton of 
vocational assessment within the market 
place. It truly is an exicting time in our 
profession representing much growth which we 
need to respond to systematically by using a 
marketing orientation. 

^■^ jstomer' f ^f^ff}^ Assessment 

The marketing strategy must include at 
least three processes; namely assessing the 
needs of potential customers, tailoring the 
service/product to meet those needs, and 
maintaining long term relationships w th 
customers to receive feedback and qua' ty 
assurance (Young, Rosati, Vandergoot, 985). 
In the next column is Fiqure II which is a 
form devised for assessing the customer s 

needs^^^^ for" is developed to be mailed to 
all current customer's of an agency. This 
creates the importance of an agency 
maintaining a current mailing 1 st which is 
easily generated from a referral list of past 
customers. An agency staff member should 
complete all items up to question one for the 
ease of recipient of the assessment form. 
Also, this survey can be given to board or 
staff members as an effort to gain other 
perspectives. Each form presented here 
should be revised to an agency's specific 
concerns or advertising modes. To assure 
timely completion of the assessment by the 
customer an incentive may be deve oped such 
as a gift certificatP. for a 10% discount on 
the next evaluation if the assessment is 
completed and returned by the scheduled date. 

This form can easily include questions 
regarding trends which may affect the 
stability of certain markets. For example, 
in Colorado when Senate Bill 79, removing 
rehabilitation services as a mandatory 
Dro"1sion on workers compensation cases, was 
passed it was imperative that one understood 
the implications of this bill. Therefore, a 
question was added to this form requesting 
the amount of "old" law cases still on 
counselor's caseloads. 



CUSTOMER'S NEED ASSESSMENT 



Dear '• 

As an effort to upgrade our services provided 
at center, your opinion would 

be greatly appreciated. 

Sincerely, 



Agenoy Name: — 

Contact Person: _ _ -r~ 

Produces Purchased in Past i2 months 



(pT?aTe"Note: Center Staff should complete 
the first 3 items for ease of customers. 
Enclose self stamped envelope.) 

1 The cur; ent image of . center is 

(please brainstorm ancTTiel free to list 
adjectives) : 



Z. , learnsd of _ c.nter^^^ssrvjc.s by. 

Phon^Book. ' 
— " Brochure, 
' Other, 

3. Your services could be Improved If: 



4. I like your services because: 




5. In the next 12 months I expect my own 
business to increase or decrease (circle 
choice) because: 



6. I would use 



center more If: 



7. What testing tools are you using within 
your office: - 



8. Comments; 
sVgnlture/fiate" 
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ConiDetjipjiVsJ^inJj^^ 

Past marketing articles emphasize the 
Importance of under.<^tand1ng the competition 
before planning your attack on certain 
markets (Williamson, Ed. Fry, 1984). Fiqure 
III illustrates one systematic approach of 
studying the competition. This form should be 
completed while awaiting the return of the 
customer's needs assessment. It also is a 
document which is periodically updated 
throughout an operating year by adding 
comments of colleagues or new evaluation 
services as they are initiated. If an agency 
has an ongoing secure, relationship with their 
own referral sources much of this information 
is gleamed In informal situations but may be 
biased. 

A few of this chart's columns need to 
be explained. The term image is basically a 
list of adjectives other persons have used to 
describe a particular program. The 
strengths/weaknesses columns are used by the 
staff member who completes this form as a 
summary of the inforniation obtained. 
Products and services are terms which each 
individual agency may define differently. In 
one agency the term product referred to the 
types and lengths of evaluation available 
inclusive of the written report with services 
beinc,\ monies generated from expert testimony 
and consultancy work. It is the expertise of 
the vocational staff that we must market, 
furthev^ evidence that we do have services as 
well as products to market and sell (Bartels, 
1985). The terminology of product creates an 
agency s personality as k competitive 
business entity in the market place. 

FIGURE III 
Competitor's Analysis Ch:rt 



COMPETITOR 




LOCATION 




MARKETS SERVTp 








PRICES 




IMAGE 




ADVERTISING METHOps__ 




[INTERAGENCY CONTRACT- 
^ITH WHOM 




jSTRENGTHS 




yiAKNESSES J 





This form is usually formatted with the 
headings on top of individual horizontal 
columns rather than the heading being listed 
as above. 



Tho Marketing Audit 

Many marketing processes do not include 
an internal audit. This is unfortunate as 
the internal climate of an agency will 
greatly Impact on the marketing potential. 
Included in the marketing Initial analysis 
should be consideration of both the internal 
capabilities of the organization as well as 
the preferences and needs of the 
organization's current and potential 
customers (Berkowtiz and Flexner, Eds. 
Flexner, Berkowltz, Montague and Brown, pg. 
88, 1981). Therefore, the following form was 
developed to synthesize the internal 
climate of an agency and the information 
obtained from the Customer's Need Asse s;rp^nt 
and Competitor Analysis Ch^ r^- This audit 
form proceeds the development of the 
marketing actio.i plan and eases this process 
by riavinc all necessary information partially 
collaborated, The marketing audit form is 
presented in detail in Figure IV . Of course, 
this form would need to be revised to a 
specific agency's programs. 

Although the audit form is self 
explanatory, some of the points need to be 
clarified. The first section, markets 
served, have tables in need of expansion for 
use but were presented here in a concise 
format. The timeline for completing this 
form Is after the needs assessment and 
competitor's analysis form are completed. 

If feasib^'e within an agency it would be 
helpful for the staff person responsible for 
the market plan development to have a 
inservice morning where all staff are 
presented with the completed needs assessment 
and competitor's analysis forms. Then as a 
team the marketing audit can be completed. 
Often, the support staff i.e. secretary's 
inputs are not systematically sought thus 
valuable perspectives not included. If time 
schedules do not permit an Inservice setting 
then copies of the marketing audit form could 
be circulated internally. 

Also, client's inputs should be 
included but distributing the form for 
completion may surpass the typical client's 
abilities Therefore, interviewing client's 
with questions adapted to their cognitive 
abilities is encouraged. 

The 1991 CARF standards states that the 
marketing plan needs to include prioritized 
objectives, action plan, communication plan, 
persons responsible/time frame and 
anticipated expenses (CARF Standards Manual, 
1989). The forms presented are providing the 
data needed to write a marketing plan which 
is entitled an Action Plan in this article. 
The authors believe that eliminating these 
preliminary forms expediates the marketing 
plan process a formality and not a practical 
process. 
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Figure IV 

THE MARKtTlNG AUDIT 

Purpose: An internal evaluation of current 
vocational evaluation services. 

A. Markets Served: 

1. How large is the current 
geographical region the center 
serves? 

2. How are the Markets grouped? 
(ex: School districts, private 
sector offices, Divisions of 
Rehabilitation, Attorneys, Parole 
Offices, Social Security — ) 



Markets 


Rural/ 




Need Asses. 


Served 


Urba^n 


Fundinq 


Rtd. 








1 



Ex of Funding: Third Party Payment, 
Grant, Private Pay, Interagency 
Contract. 



3. Demographics of Markets Listed 
in Question 2. 



Market 
Served 


# of 
refrls 
in past 

12 TIOS. 


# of 
rfrng 
Couns- 
elors 


Products 
Purchased 


Average 
Age of 
Client 













4. What is image of your center by 
markets served (List comments 
from customer needs 
assessment) . 



B. YOUR CENTER 

1. Center's income/revenue for 
past three years. 



2. New Markets added in the past 
year. 



3. According to Customer Need 

Assessments, how did purcha^Grs 
hear about center? 



4. What ars centers current 

strengths and weaknesses? (i.e. 
facilities, location, image, 
report turnaround. . . ) 



6. What kinds of oxLornal controls 
affect the center? (i.e. 
accrediting agencies 
legislation) 

C. COMPETITORS 

1. Who are the center's 
competitors? 



2. Have competitors increased or 
decreased in past year? 



3, Drawing from Competitor 
Analysis Form , what are 
competitor's products/services? 

D. PRODUCTS AND SERVICES 

1. Products and services currently 
provided by center (i.e. 1,2,3 
day comprehensive evaluations, 
career exploration, screenings, 
expert testimony, speakers 
bureau, work tolerance, 
transferrable skills. . .) 

Services/Product s_^ ^ 

Personnel Responsible 

% of Bus^n**^^ 

Critiquf' i/alueTf Prod./Serv._ 

How long have been Providing 

Price „ 

Primary Customer 

2. How are prices for services/ 
products determined? 



3. When were prices reviewed? 



4. What products/services would 
staff like to see added or 
deleted in next 12 mjnths? 
Next 3 years? 

E. ADVERTISING 

1. What are current methods of 
advertising? 

2. What advertising methods have 
been added in the past 12 
months? 



3. To whom nre the current 

advertising methods targeted? 



5. What is turnovi-r rate of 

center's employees (evaluators/ 
certi fi(^d, technicians, 
secretarys) . 



4. According to the Customer Need 
Assessment results rank 
ndverti sing methods by 
effectiveness. 
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Act i en . Plan 

This is the form which attempts to 
address the CARF standards specifically, A 
plan is completed on each desired objective 
with the agency mission and frequently the 
marketing goal being consistent throughout. 
Objectives should be written in an 
affirmative action sense 1,e. "will" versus 
will not", Activities should be listed In 
chronological order and very specific, Often 
the targeted service area is included in the 
objective statement but Is repeated again in 
Us' specific area. This allows for future 
cost analysis by targeted area or assists 
program evaluation efforts. Anticipated costs 
should be broken down Into line items as 
Identified by the activities previously 
listed and then totaled per objective. 

Possible future trends may have been 
identified by the last section on the 
Customer Needs Assessment , CARF emphasizes 
this area greatly. Examples of possible 
trends are listed below for clarification; 

Community: New low income housing 
being funded increase 
in blue collar workers. 

Government: Leulslatlon pending 
regarding llcensijrt^ 
of rehab, counyelgr?, 

Competitors: New Rehab. Upi^ 
adding new eval. 
staff . 



Next, the pi i requires identification 
of advertising methods. These, too, should 
be specifically addressed and costs 
identified. Interagency agreements should be 
investigated and may include such things as 
JTPA monies, contractual agreement with 
school district, residential facility or 
Division of Rehabilitation. 

The evaluation of objective and actual 
costs are completed at an established time 
period such as 12 months after the plan 
initiation. Other action plans also Include 
a space for revision of activities and 
objectives so a quarterly r^^- ^r^.* can be 
completed and ongoing changes documented. 

This is the step by step process for 
completing the action plan which some may 
choose to title Marketing Plan . The purpose 
of this document Is to contribute to an 
agency's business and image therefore be sure 
to represent your agency realistically. 
"Define your service and be comfortable with 
your production rate". (Williamson, Ed. Fry, 
pg. 18, 1984). One should not get caught in 
the thought paUern that marketing T.oans 
exp. nsion of your programs. Current agency 
provrams m^^y bo optimal but still require 
marketing to maintain buch programs 
effectively. 



Figure V 

ACTION PLAN 
Agency Mission:' 



Marketing Goal : 



Marketing Objective HI: 



Activities with timeline and initials of 
responsible staff: 

a- 

b- 
c- 
d- 



Targeted Service Area: 



Anticipated Costs: 



Possible Future Trends Impacting on 
Objective: 

Commun i ty 

Government 

Economy 

Labor Markets 

Consumer Needs_ 

Service Area " 

Competi tors 

Funding^ 



Advertising Methods: 



Interagency Agreements Feasible: 

With Whom? 
Document Signed 
Feedback Procedures: 



Evaluation of Objective, activities and cost: 



Actual Costs^. 



Date Initiated: 



Date Completed: 
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FqHow Un 

The form in the next column is designed 
as a tracking mechanlsn^ of all marketing 
efforts during implementation of the 
marketing action plan. By completing this 
form on each mart^ting effort it will provide 
the needed program evaluation and budgetary 
information to revise or implement a new 
action plan. It will also expedlate the next 
plan development. 

The agency's secretary responsible for 
mailing brochures or responding to requested 
information about programs available should 
also be completing a form on each mailing. 
The form also allows for periodic updates of 
the agency's mailing list. The secretary 
should be able to pull these forms quarterly 
and add new person's contacted to the mailing 
list. 

To have an effective mailing list it 
should be coded. For example, the computer 
should be able to generate multiple mailing 
lists from the masler list such as a list of 
current customers, new customers, cclleagues, 
and inquiries into services. The cost per 
mailing should be identified at the time of 
the market plan development. Tnerefore, the 
secretary checks the established cost list to 
determine the price difference for a mailing 
with brochure only as compared to a iiailing 
with sample referral questions and a sample 
report. 

Conclusion 

This article attempted to present sample 
forms needed to develop a marketing plan 
responsive to the CARF standards. The 
emphasis was on internal as well as external 
need assessments prior to writing a market 
plan termed an action plan in this article. 

It Is apparent that to be competitive in 
the market place vocational evaluators will 
have to advertise and provide quality 
services. , "To serve the private sector well, 
thu vocational evaluator must respond to the 
time and cost restraints of the system and 
provide more or different services than the 
rehaoilitatlon counselor has available in 
his/her office" (Comegys and Smith, Ed. Fry, 
1987, pg. 205). This article's presented 
forms including determination of those 
services that the rehabilitation counselor 
has at their own disposal so that duplication 
of services and client's time will not 
resul t . 

It is an exciting time in rehabilitation 
knowing that tho disabled popualtion can meet 
the needs of the decreasing work force in the 
fjture. At the crux of all successful 
placements is some aspect of assessment. 
Ev-iluators are requested to be proactive in 
this expansion by marketing vocational 
assessment services and thus addressing such 
expansion systemaHcally and successfully. 



Figure VI 

MARKETING F0LL3W-UP TRACKING SHEET 



DATE 



PRODUCT/ 
SERVICE OF 
INTEREST 



ADVERTISING 
METHOD/COST 



PERSON 
CONTACTED 



MATERIAL 
SENT 



STAFF 
INITIAL 
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LWDERSTANDING THE LWIOE OONIRIBOTIONS OF OCCUPATIONAL TOERAPY 
WITHIN VOCATIONAL ASSESSNENT 



NANCY NCCRACKEN, PH.D., COT 



Abstract 

As interest and need for vocational assessment of 
special populations has increased, the unique 
contributions of various allied professionals has 
become blurred, ihe purpose of this paper is to 
promote understanding of the role of occupational 
therapy within an interdisciplinary approach to 
the vocational assesamant process. The domains of 
Saractice in occxspational therapy anfl vocational 
evaluation are described, iwo frames of reCerehce 
used by occupational therapy in services to 
persons with physically handicapping conditions 
ari delineated. Applications of occupational 
therapy la discussed within those framsworks. 
Differenfces in perspectives of occupational 
therapy and vocational evaluation are di-awn to 
facilitate the understanding of the unique 
contribution of occupational therapy, ihese 
perspectives are described in temw of the scope 
of evaluative information gathered, task analysis, 
and adaptatlona for the worker with physical 
d:,'9function. 



IntroriufTtlnq 

Aissessment of vocational potential for persons 
with disability requires careful attention to a 
number of factors from a variety of perspectives. 
In order to address those mil ti -faceted factors, 
the expertise contained within several disciplines 
is required, it is generally held that an 
interdisciplinaury approach to vocational 
assesanent for persons with disability is 
essential . Ihe advantages of a confined effort 
are threefold: 1) assesamsnt can be addressed by 
professionals with unlqua areas of expertise; 2) 
results from different profeaslonals serve to 
validate evaluation results; and, 3) 
interdisciplinary evaluations allow the individual 
to be viewed within different perspectives and 
contexts. The interdisciplinary approach can 
theireby sarve to enhance outcome of evaluative 
Inforiration, ensure valid results, and facilitate 
a climate in vhldi creative alternative solutions 
may be generated. However, as Interest and need 
for vocatloral assessment of special populations 
has increafied, the unique contribution of each 
allied profession has come under scrutiny. Of 
particular Interest to this discussion are the 
Interrelated roles of the vocational evaluator and 
occupational therapist. 

Ihe purpose of this paper is to examine the 
potential roles of occupational therapy within a 
systematic approach to vocational assessment it 
is the intent that the reader will be better able 
to conceptualize the role of occupational therapy, 
differentiate specialization of occupational 
therapy and vocational evaluatiori, and to 
appreciate the continued need for 
interdisciplinary interactions within the 
vocational assessment process. To this end, 
comments will be directed towaids basic roles and 
functions of each profession. 

a^g Dvnin Prnntirft In occunatioi-wi Thnrapy 

Occupational therapy is defined as "the art 
and science of directing man's participation in 
selected tasks to restore, reinforce and enhance 
performance, facilitate learning of those skills 
and functions essential for aaaptation and 
productivity, diminish or correct pathology and 
protiiote and maintain health." (p. 3 Hopkins and 
Smith, 1988) The key concept in occupational 
therapy is therapeutic use of self-care, work and 
play activities to increase independent function 
and may include adaptation of task or environment 
to achieve maxiirum independence and to enhance the 
quality of life. (Hopkins* and Smith, 1988) 

The domain of concern in occupational th-irapy 
focuses on purposeful activities of persons with 
handicapping conditions related to: a) physical 
daily living skills (e.g., grooming, hygiene, 
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feeding/eating, dressing^ functional mobility^ 
functional camunlcatlon; object imnipulation) ; b) 
psychological/emotional daily living skills (e,g,, 
self'-concapt/self-identity, coping with life 
situations, and participating in one's 
organizational and comiunity environment); c] play 
and leisure skills; and work skills. Work refers 
to skill and perfomence in socially purposeful 
and productive tasks v4iich include hcmeneking, 
child care/parenting and estploynent preparation, 
Within the context of occupational therapy, 
enploymsnt preparation eKlcbresses precunory job 
activities including: prevocational activities 
(physical capabilities and daily living skills); 
work process skills; work product quality; and 
organizational and team participatory skills and 
perfonrance. (ACTA, 1983) 

Organization and use of occupational therapy 
within vocational rehabilitation is not a now 
concept. As in the vocational rehabilitation 
movement itself, applications of occupational 
therapy ^in work-irelated contexts began with the 
needs of disabled veterans of World War I and 
World War II. Growth of the profession of 
occupational therapy and needs of the society in 
rehablHtation services has expanded the practice 
of occupational therapy to all major disability 
groups, i.e. , physically dysfunctional, 
developnentally delayed, peychosocially 
dysfunctional. In addition to the traditional 
places of service (rehabilitation canters, long- 
term care centers, and acute treatment center), 
occupational therapy is currently practiced in 
coimunlty-baMd haalth systems, school syitems, 
sheltered work CMiiers, comainity--ba8ed enploynent 
programe, hi^-risk infant treatment, and early 
intervention programs* 

Occupational therapy can play a dynamic role 
within the vocational assessment process for 
persons with disability, especially those 
individuals with severe limitations. To 
appreciate the roles and contributions 
occupational therapy can make, it is necessary to 
understand the structure and processes of 
vocational assessment. 

TYio Doinain of Practice in Voc ational Evaluation 

Vocational assessment can best be understood 
from a systematic approach. (Maki, et.al,, 1979) 
The process includes j 1) specifying the objectives 
of the assessment; 2) defining the content areas 
to be investigated; 3) gathering appropriate 
evaluative information, including vocational 
evaluations; and, 4) development of a vocational 
rehabilitation plan through analysis, synthesis 
and interpretation of the information. This 
process is predicated on knowledge of; the wrker 
personality and the work environment (Dawis anc? 
Lofquist, 1984); theories of the psychology, 
sociology, and culture of w^rk (Crites, 1969); 
spe( if ic standfiOPds for performance of jobs, 
ocapations and vocations; and political 
influences and govenvmntal regulations affecting 
the world of work and vocational rehabilitation. 

Ihe domain of concern of tlie vocatlon/il 
evaluation rests within the continuum of 



assessment of tasks, positions, jobs and 
occupations. Itiis continuum may be viewed in a 
general hierarchical structure: Tae scope of 
occupation includes the grouping of similar jobs 
within a specified occupation. In turn, jobs are 
carposed of the nurober of positions representexl 
within the specific work environment. Each 
position is carposed of a group of tasks perforrned 
by one person. Elements of each task can further 
describe the specific nature of the work 
performed. (Crites, 1969) Vocational evaluation 
includes measurement maximal and typical behaviors 
associated with work performance and work 
behavior. Ktoimal behaviors include: aptitudes, 
intelligence, achievement. Typical behaviors 
lucludei work personality, vocational interests 
and needs/values related to work. 
(Maki,et.al . ,1979) Maasurement of worker 
attributes are made with reference to the entire 
continuum of occupational analysis. Thus, the 
vocational evaluation provides professional 
jt^emsnts regarding individuals with handicapping 
conditions and their awployability relative to 
specific job regMirements , transferability of 
skills, projection of the client's potential 
occupational level , forecasts of existing and 
potential occupational trends and job markets, 
feasibility of vocational training and 
development, arvd job placement decisions. (Bolton, 
1976; Mcloughlin, 1967) 

tiniqiift CQnt,rih^*<"n,^ of Occunation^l Therapv 
Witllln T^*^ Vorjitinrml Aggegnnwnt Proceaa 

Occupational therapy offers uni<;^ie 
contributions to the process of vocational 
assessment. Occupational therapy addresses the 
underlying components of work related tasks < 
sensorimotor, cognitive, psychosocial conponents; 
arvd relevant daily living skills. Assessment of 
these underlying oonponents is predicated on 
knowledge and understanding of aratomy, 
kinesiology, physiology, neuroanatony, 
neurophysiology, psychology, sociology, and human 
development. This knowledge is integrated with 
theories of purposeful activity, the meaning arid 
dynamics of activity, and perfomance of selected 
life Usks (self-care, work). (ACTA, 1983) 
Depending on ti\e population served, primary 
dysfunction of the client, and setting within 
whidi services are retired, occupational therapy 
may be eipplied from one or more frames of 
reference (e.g., developmental, object relations, 
sensory integrative). 

For the purposes of this discussion conrnents 
will be restricted to two frames of reference used 
in services for persons with physically 
handicapping conditions— i biomechanical and 
neuromotor frames of refer^^ce. 

Thft hiOTftchanical frame of reference in 
occupation;^! tLeraPV! 

"Skeletal muscle movement is the result of 
rruscle strengtli, physical mdurance, joint 
mobility and range of motion. The objective of 
this frame of reference is to restore movement. 
Biomochanical techniques are baaed on the 
mechanical principles of kinetics and kinematics.' 
(Kalscheia and Karl, in press) 
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"The neuroiTPtor frames of reference are based 
on motor learning, develoginental and 
neurophysiologlcal theories, The focus of 
neuroinotor frar^ios of reference Is not In 
coiii»nsatlon but the reinedlatlon of inpaiments in 
posture and nwveroent." (Kalscheur and Kari, in 
press ) ' 

The underlying components of function which 
occupational theripy may address in either frame 
of reference includeai neuromotor, 
perceptual /tnotor, cognitive/ho tor, 
nusculoskeletal, sensory awareness, and daily 
living skill cotponents. Given the above frarros 
of reference in occupational therapy, let us 
examine contributions which can be" made within 
each step of the described vocational assessmsnt 
ptticess, 

fiM l a and ohiectivii^« of fh^ A««^ f nffnf n rnrnnr 
Vtien objectives delineate .concern about the 
client 8 status in daily living skills related to 
wrk (e.g., toileting), strength, motion, 
coordination and/or perceptual functioning 
occupational therapy can be utilized effectively. 

The content to be investigated within the 
bionechanical and neuromotor frames of reference 
includes the following areas: 

1) Maximal Behaviors (maxiiml tolerances): reflex 
integration; gross and fine motor coordination; 
strength; endirance; sensory aweroness (e.g. , 
tactile, kinesthetic, ptopriocepfcive, vestibular 
avaroness); visuospatlal awareness; orientation; 
attention span; memory; and (2) TVpical Behaviors 
(characteristic use of capabilities)! irotion; 
sensory Integration; body inteqration; cognitiv/o 
integration; problem solving; concentration. 

CollftntJng p^tn ' 

Clinical occupational therapy evaluations are 
based on a functional approath where the clients' 
abilities and deficits are evaluated relative to 
three life task areas: self-care, leisure and 
wrk. The typical evaluation includes 
investigation of the sensori-motor system; 2) 
applied cognitive and perceptual functioning; and 
3) independence in daily living skill. These 
d4ita are collected and conpared to the unique 
skills and abilities the individual most possess 
to be functionally indeperrient within his/her 
situation and general life role. 

Occupational therapy evaluations may also be 
designed to address specific work-related tasks. 
This may be done within the context of behavioral 
analysis, situational assessment, or siirulated 
work tasks. 

Analysis of data ;^r^ fftpnilAit^f^ pl f^ p ' 

Ttie results of occupational therapy 
evaluations are analyzed with reference to the 
individual and v»rk-related tasks required within 
their environnient. The majority of evaluative 
measures are non-standardized and observational in 
nature. Results are typically analyzed and 



interpreted wiUiin in a clinical (rather than 
statistical) framev»rk, eitploying keen 
professional judgements based on detailed 
neuromotor, perceptual /motor, cognitive/motor, and 
physiological functioning, Individualized plans 
are generated to maximize the client's perfornBnce 
an^j work behaviors through therapeutic 
interventions including: correction of pathology 
vis a vis treatment, remedial training in daily 
living skills associated with work petforronce, 
environmental adaptations, tool modifications, and 
modifications of vwrk-tasks vhich are consistent 
with the physical and physiological cotriitions and 
needs of the client, 

Differences in P^rflnectivAs !v.», v»en ornip^^tlft in^ 

Iheraov And vocational EvahiAtinn 

Ihe ultimate aim In vocational assessnmt is 
to discover an optimmn fit between the individual 
with disability and the work environnwt. 
Ihe differences in 'content' of evaluative 
information collected by the occupational 
therapist and vocational evaluator have been 
described above. In the inteixaisciplinary mode, 
and with the varying domains of concern, there are 
notable areas of comoa concern within the 
evaluation process. However, vocational 
evaluation and occupational therapy make 
tJrofessional contributions from different 
perspectives. Ihe following ccimwits describe 
differences which enrich the -vocational assessment 
process . 

Differences in sconB of AVA^ufit.j ye infni-m^Hon 
flflUafiMdi — 

As indicated above, vocational evaluation 
acWresses the continuum of occupational analysis 
including tasks, positions, jobs, and occupational 
levels. Evaluation is predicated on knowledge 
related to the worker personal ity, the work 
environment, potential occupational levels the 
client can achieve, forecasting of occupational 
trends relevant to client job placemsnt and 
training. 

Ocoipational therapy addresses the areas of 
precursory activities in employmsnt preparation, 
prevocational developnent (including physical 
capacities and daily living skills) which is 
predicated on knowledge related to detailed 
neuromotor, perceptual /motor, and cognitive/motor 
aspects of work-related tasks. 

Differences in persiXK-tives nf f^ sk An^i Yff^''' 

Task analysis from a vocational evaluation 
perspective examines performance in relation to: 
v»rk rec^irements and standards for work 
production; episodic and job-related routines 
(McLoughlin, et.al,); materials, products, and 
procedures vrithin the total context of the work 
place (i.e., total production requiremant of the 
particular plant or business); job descriptions 
and specification; supervisory and management 
relationships; labor relations and goverrumntal 
regulations. 

Task analysis from the perspective 
occupational therapy examines the underlying 
conponents of the work-related activity rolaiive 
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to the individual's functional abilities and 
functional deficits in detail, including; notor, 
sensory awareness, cognitive, psychological, 
social, cultural, and developoiental conponents of 
the work tasks. 

Differencftg in pers p iy;t- 1 V*^ adaptations and 
fmvironnisntal rftxii f Icatlons s 

Adaptations and envlronnwital modifications 
from the perspective of vocational evaluation are 
primarily directed to facilitate work production 
axyi work brtiaviors, given the context of the 
irKlistry or business as a viiole. 

Similarly/ adaptations and environmental 
modifications from the perspective of occupational 
therapy also address work performance and work 
behaviors of the client. However, the focus Js 
primarily directed tcwBrds enhancing the 
Individual's capabilities to perform the wrr*k 
task. 

For exanple, the occupational tJieraplst's goal 
is to ensfure the client is usinq the most 
effective* and physiologically sound pattern of 
movement. 

fldnlttedly, these contrasts In perspective are 
overlapping and are not nutually exclusive. 
However, they are useful In understanding the 
unique contributions of occupational therapy 
within the broader context oC vocational 
assesamont . 

Whether vocational assessmsnt takes place 
vdthln a *»-'*dltlooal vocational MMnBomt format, 
a rehabilitation setting, or In conmmlty-based 
envloynmt, evaluation strategies den»nd •ttantlon 
to nultlplo needs of the person with disability. _ 
Moreover, vocational assessment reenirea a 
nultidlsclplinary approach to ensure valid results 
of evaluative Information, to promote a holistic 
approach with clients, and to expand the potential 
for creative solutions. Clearly, occupational 
tharapy Is one discipline whldi can be u««a 
effectively In enhancing the depth and breadth of 
the vocational assesrwt process, esp«:lally v*jen 
addressing the detailed underlying corponents oC 
work task performance. 

Rwfurancefl 

American Occupational Therapy Association [ACTA] 
(1983). Essentials and guidelines of an 
accredited educational program for the 
occupational therapist. gmwriGfln Jt?umfli.Q£ 
nnmim^inP'*^ l^«raPV 31i817. 

Bolton, B. , Ed. (1976). Hflt^lhoftK Qf Mwfn i rflmBnt 
flPr] f^.u,^tic^ in RfthflbililflUoQ. Baltimore: 
Uavergity Park Press. 

Crites, John 0. (1969). Vftfiftlionfl l P a y fi ho i ogv - 
New York! McGraw-Hill Book Conpany. 

Dawis, B.V. and Lofquist, L.H. (1984). B 

Minneapolis! university of Minnesota Press. 



Hopkins, H.L. and Smith, H.D., Eds. (1980). 

wniard and Srvtrkit y in'^ Dccuewtional TtlBmPV I7U 1 
^Itlon^ . New York! Lippinicott Conpany. 

Kalscheur, J. and Kari, N. (in Press). CUtlica l 
rftlT^"''^ MaK^"g Qcnipationfll Therapv. 

Maki, D., Mccracken, N., Pape, D., and Scofield, 
M (1979). A systems approach to vocational 
assessment. J^imFll flf p*^>*^■^ Htatlon. 10 (1) 
48-51 . 

Msloughlln, C.S., Gamer, J., and Callahan,, M. 
(1987) . nwt.t.in^ Bttf lflYfflir Staving Ehcloved. 
Baltimore! Brookes Publishing Conpany. 



81 



ERIC 



NATIONAL FORUM 



81 



REHAV.iLITATION COUNSFLING AND OCCUPATIONAL THERAPY 
WORKING HAND IN HAND 



Mary Fryman and Carol D. Melickian, OTR 



Abstract 

Although work haraening programs are 
hardly unique, the approach used by 
Louisville Hand Surgery in Louisville, 
Kentucky, differs from traditional 
approaches by involving professionals from 
both occupational therapy and 
rehabilitation counseling. While 
competition among the two" fields is keep 
dollars, this does not 
prohibit a team approach of this kind, in 
order to have a successful treatment 
program for the injured industrial worker, 
one must pay attention not only to the 
actual physical injury but to the patients 
absociated vocational problems. This paper 
outlines the approach of Louisville Hand 
Surgery and discusses the integration of 
professional services from both the 
medical and vocational rehabilitation 
field « 



The cost of health care has risen 
considerably since 1965, at that tiiae the 
united states spent approximately 55 
billion dollars on health care costs. 
Today that cost has skyrocketed to about 
500 billion • The responsibility for a 
large percentage of ^.hese costs lies with 
industry, which supplies insurance thru 
benafit packages and programs, (Baum, 
1987) Consequently, industry will closely 
scrutinize how this money is being spent. 
Competition for hc*)ilth care dollars will 
arise because of industry's closer 
examination of funds. Rehabilitation 
counselors and occupational therapy are 
among the groups of professionals who 
will be competing for the same dollars in 
this changing marketplace, (Baum, 1987) 

The return-to-work programs grew out 
of an awareness to the needs of industry 
to ret irn tho injured workex to the work 
place as soon as possible* (Baum, 1987) 
Such programs have grown quickly in terms 
of their numbers, (Pendergraft, 1987) it 
has been estimated that this "particular 
field will increase over 300 percent 
within the next five years," (Brandon, 
1987) In today's marketplace, successful 
return-to-work programs mean cost 
efficient rehabilitation; i.e,, providing 
quality service while keeping costs down. 
However, stricter control of services 
combined with an aging popula- tion and 
fewer restricted work opportuni-ties at 
the workplace add to the challenge faced 
by the professionals working in these 
programs. 

Because of this increased growth of 
work hardening programs, attention should 
be directed to their professional 
staffing. As Katrina Pendegraft noted in 
last year's conference, Many work hard- 
ening programs are employing a multi- 
profecjsional staff to deal with the 
complex needs of the injured worker. 
Through the employing of professionals, 
such as 1 ehabilitation counselors and 
occupational therapists, work hardening 
programs are able to utilize tho unique 
skills and background that eacn profes- 
sional brings with it, (Pendergraft, 
1987) ^ 



8'^ 



With medical and vocational 
assessment, the injured worker's 
situation is comp-ehnnsively addressed. 
Should medicil evaluation provide data 
that verifies that the worker is 
incapable of safely returning to the 
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workplace^ vocational assessment is used 
to facilitate job placement. (Baum, 1987) 
This multidisciplinary approach will 
result in more cost efficient 
rehabilitation since all services are 
coordinated during the initial phase of 
the program. Out of responsibility to 
industry and the injured worker, many 
work hardening programs are now employing 
both professions in their programs. 

At Louisville Hand Surgery, 
rehabilitation counselors and 
occupational therapists enjoy a 
succesnful professional relationship. 
Both service are used primarily in the 
Back-To -Work Program, where all 
professionals pool their knowledge and 
resources for a successful return-to-work 
for the hand injured patient. The 
structure of the program itself 
encourages a coordination of services 
rather than competition. The ability of 
the rehabilitation counselor and the 
occupational therapist to work together 
h\s proved beneficial to the development 
of the Work Hardening Program, but 
especially important to the client in 
regard to returning to work, (isernhagen, 
1988) By working together, the 
rehabilitation counselor and the 
occupational therapist increase 
communication between the medical setting 
and the workplace. This increased 
communication aids in decreasing problems 
associated with determining a person's 
capacity and readiness to return to work. 

The work hardening program begins 
with a referral from the primary 
physician. The patient is scheduled for a 
job analysis and a work capacity 
evaluation with the rehabilitation 
counselor and occupational therapist 
respectively. The job analysis (interview 
or on-site visit) , determines present 
work demands, modifications available, 
and availability of liaht or restricted 
duty. The work capacity evaluation is 
based upon the job's actual demands. This 
evaluation includes active range of 
motion measurements of the involved 
extremity, manual muscle test, fine motor 
and dexterity test, two-point 
discrimination and stereognosis, grip and 
pinch strength and grip endurance. Each 
participant is also evaluated as to how 
they can perforin the various tasks of 
their job at the present time, such as 
pushing, pulling, and lifting (amount of 
weight) . Participation in the program 
involves daily work tasks and specific 
exercises monitored by the occupational 
therapist. During this period, the 
rehabilitation counselor, serves as a 
liaison bet-woen the medical setting and 
the workplace and maintains contact with 
the employer to determine job placement 
options • ( Isernhiagen) 



Upon completion of the program, the 
occupational therapist and the 
rehabilitation counselor meet with the 
staff physician to inform him of the 
patient's progress and work situation. 
The information provided to the physician 
by the rehabilitation counselor and the 
occupational therapist enables the 
physici?»n to make an objective decision 
In reel, rds to the patient's work status. 

a..e following is a case study of an 
industrially injured worker who 
participated in the Back-To-Work Program, 
at Louisville Hand Surgery staffed by an 
occupational therapist and a 
rehabilitation counselor. 

Ms. S. a 47-year-old machine 
operation was injured through an 
industrial accident. She had a lengthy 
recovery period requiring several 
surgeries and has been off work for over 
a year. Her contact with her employer 
since the accident had been sporadic, and 
she harbors a great deal of resentment 
over her present limitation and was quite 
hesitant to return to work. She was 
referred to the Back-To-Work Program by 
her physician in an effort to return her 
to her workplace. 

lis. S's job involved a variety of 
machines and duties, making it difficult 
for the therapist to visualize and thus 
simulate in the Work Hardening Program. 
Ms. S's employer was thus contacted by 
the rehabilitation counselor for an on- 
site job analysis. The rehabilitation 
counselor visited her workplace, talked 
with her employer, and evaluated her 
required tasks. Her work hardening 
program was then developed by the 
occupational therapist from the 
information frcm the job analysis, 
simulating her job and targeting the Dob 
skills that her Work Capacity Evaluation 
indicated were limited* Ms. S was 
scheduled daily for 2 to 4 hours of work 
hardening. She often expressed her 
resentment regarding her injured hand and 
hesitation about returning to work since 
this would require her to use the machine 
through which her injury occurred. During 
the weeks Ms. S was in the Work Hardening 
Program, she met with the rehabilitation 
counselor at least once per week and 
discussed her concerns about her injured 
hand and return to work. 

After 4 weeks in tho program, Ms..s 
'•^as re-evaluated to determine her 
improvements and was then seen by her 
physician. Objective emdical information 
from the work capacity evaluation 
demonstrated that Ms. S was able to 
return to her job her physician agreed 
that she wa . physically ready to return 
to work. Because of her hesithnce about 
using the machines, it was decided that 




.1 



II«;A"2'^^^ complete a trial return-to- 
work before making a final decision. 

The rehabilitation counselor 
contacted Ms. S's employer to arrange a 
lime when she could return for a trial 
visit. During the job trial, the 
occupational therapist made various 
adaptations (i.e., built-up handles on a 
machire and lower work surfaces) so that 
her joto tasks could be performed easier 
and safer. 

wa^ .i^ job trial, Ms. S proved she 
was able to perform her duties well, and 
she expressed increased confidence while 
working with the machines. This 
infonaation was then reported to the 
physician where he released her to go 
back to work on regular duty. 
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ABSTRACT 
The purpose of this study was 
to utilize a non-relational d^Lu 
base program to collect data for 
mutual clients of'the UNT--Vocav:ional 
Rehabilitation Center "s vocational 
evaluation and work adjustment units 
to determine what advantages would 
be gained by th« "computerization" 
of the V.^<C program evaluation 
system. 

Twenty selected variables were 
xdetntified for a total of 78 mutual 
ul:wents. After several hours were 
spent in learning to use the 
program's functions and options, 
several repor+s were generated using 
the *'crosstabulation" (cross tab) 
and "list" functions of the program. 
The approximate time to create ahH 
print the reports was 10 minutes per 
report • 

One of the outstanding features 
of this type of program is that 
report instructions can be stored 
using the "save report" option. 
This allows a list or crosstab used 
on a regular basis to be regenerated 
easily. in such cases as program 
evaluation, monthly reports and 
staff performance reviews, the time 
spent on tabulating results is 
greatly reduced . Th ^ reports 
generated demorstrate the 
versatility in comparing occurrences 
of data for one variable with other 
variables. The ability to summarize 
bot.^ text and numerical information 
was also demonstrated. 

The use of a formalized data 
base system using this type of 
program would benefit the functions 
ol program evaluation, staff 
performance monitoring and research. 
Reviewing intormation collected on 
services delivery allows for the 
identification of strengths and 
weaknesses of the prograns. In 
addition the data base provides a 
historical record which could be 
utilized for research by extracting 
variables to a statistical analysis 
program. 



OVERVIEW 
Program Evaluation in 
Vocational Rehabilitation was 
maiidated by the Rehab/ litation 
Act of 1973 , When the state 
vocational rehabilitation 
agencies were required to 
provide an annual evaluation of 
the effectiveness of their 
vocational rehabilitation 
programs in meeting the goals 
and priorities set forth in 
their State Plans , General 
standards for program 
evaluation were first submitted 
to the Rehabilitation Services 
Administration (RSA) in 1975. 
These standards in effect, 
mandate collection of the data 
to evaluate program 
effectiveness , The data 

collected for each client 
served are: 

i clients are placed in 
gainful activities suitable 
to their capabilities; if 
clients rehabilitated retain 
the benefits obtained from 
the rehabilitation process; 
if clients are satisfied 
with the vocational 
rehabilitation services as 
developed with the 
counselor; if available 
resources are utilized to 
achieve maximum operational 
efficiency (Weisinger 1975 
p. 52). 
The data elements collected 
to compare with the standards 
cover the general areas of 
placement, earnings, 
successful closure and client 
satisfaction with services,^ 
and cost of services. Follow- 
up variables recognized as 
measures ofprogram 
effectiveness include, change 
in clients welfare status, 
income increases, job 
retention, job benefits, change 
in skill, and measurements of 
employment satisfactoriness 
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(Weisinger, 1975). 

The identification of pertinent 
variables has not been a problem in 
program evaluation of rehabilitation 
facilities. These have been 

suggested by the RSA in 1975 and 
have not changed significantly. The 
volume of data, however, has 
increased due to the expansion of 
the eligibility criteria to include 
more clients in the vocational 
rehabilitation process. The need to 
disseminate information from that 
data to a variety of sources such as 
educational and mental health 
facilities has also placed strain on 
f acil ity data management process . 
(Eleventh Institute on 
Rehabilitation Issues, 1984). 

The fundamental purpose of 
program evaluation is concisely put 
by several authors. They suggest 
that though the process of data 
collection and synthesis is a job of 
large magnitude, the goal of 
determining if the program performs 
its mission should be accomplished 
by asking vary basic questions. As 
proposed by Bennett and Weisinger 
(cited in Weisenger, 1975) program 
evaluation is "a statement of fact 
about how well the objectives were 
met", (p. 50) . 

The increasing emphasis on 
program evaluation is based on 
specific federal and state 
legislation, state agency policy, 
and consumer demands (Graham 1980) . 
These influences and the advent of 
affordable computer-based data 
collection systems provide the 
impetus to develop state of the art 
management inf oxitiation processes , 
processes that will allow more 
effective and efficient feedback to 
facility staff, to referral sources 
and to governing authorities. 

As stated by Burstein and 
Freeman (1985), ''the ( leanest way of 
minimizing data collection problems 
is to anticipate them in the design 
of the evaluation". In this cape 
the design being the storage nd 
retrieval mechanism. The use oi a 



computerized records systen^ 
would create raorr efficiency in 
information retrieval ^nd 
effectiveness in the production 
of program evaluation reports 
by decreasing the amount of 
staff time needed to collect 
and tabulate the data and allow 
for more frequent evaluations. 
This would provide for the 
ongoing client monitoring 
process and would facilitate 
the management functions of 
program planning and analysis 
of outcome variables. 

Stoner (1978) points out 
several considerations for the 
development of a management 
information system. He 
suggests that (a) the user be 
allowed input in the designing 
of the system to ensure that 
all appropriate information is 
included in the data base, (b) 
that relevance and selectivity 
of information should take 
precedent over quantity of 
information, and (c) the users 
of the system should be 
carefully trained to ensure the 
accuracy of the data put into 
the system and to ensure that 
they know how to get 
information out of the system. 

PROCEDURE 
The data for this study 
consisted of twenty variables 
from casefolders of a 
rehabilitation facility. It 
was collected by a graduate 
student at North Texas State 
Universtiy, who had two weeks 
experience using PFS:File. 
The student had aproximately 
two years experience with the 
work adjustment program dealing 
with the client programming and 
the case folders. He had 
approximately three months 
experience in the vocational 
evaluation unit working with 
clients and the case folders. 
The approximate time to 
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collect and enter the ten vocational 
evaluation variables was 15 minutes. 
The ten work adjustment variables 
required approximately 30 minutes to 
collect and enter. 

Reports were generated using 
the crosstabulation and list 
functions of the program. The 
approximate time to create and print 
the reports was 10 minutes per 
report. Several hours was spent in 
learning to use the functions and 
their options. 

One of the outstanding features 
of this type of program is that 
report instructions can be stored 
using the save report forinat option. 
This allows- a list or 
crosstabulation used on a regular 
basis to be re-^generatod easily. In 
such cases as program evaluation, 
monthly reports and staff 
performance reviews the time spent 
on tabulating results is greatly 
reduced . The reports generated 
demonstrate the versatility in 
comparing occurrences of data for 
one variable with t.ther variables. 
The ability to summarize both text 
and numerical information was also 
demonstrated . 

The ability to easily and 
quickly coiftununicate the information 
"as is" and in summary form, that 
is r counted , al^id , averaged , eto . , 
allows for t;he identification of 
trends in client characteristics. 



TREATMENT OF VARIABLES 
The following reports were 
generated using the Professional 
File Report (1987) function which 
sorts and lists selected infoinnation 
in any desired combination* The 
program allows the report to be 
saved to a disk file, a 123 
Lotus worksheet file or routed to a 
printer or to the screen . The 
variables are identified on the list 
format screen by numbering the 
desired variables in the order 
desired ar.i are identified on the 
search format screen to indicate 



which records to include in the 
list (PFS: Professional File 
Manual p, 8-2) • 

Table 1 is a report 
generated by numberinci the 
desired variables on the sort 
instruction screen and 
selecting various options to 
enhance the information 
retrieved. Options included in 
this example ''"ere I 
( invisible, causes the column 
to be used for sorting only) , 
C (count, produces a frequency 
total at the end of the 
column) , A (average, produces 
the mean of the column) . The 
variable order and options 
selected in this case were PVRC 
: 1 I, ST: 2 I, DOB: 3 C, TW: 
5 A, ATWA: 4 A, and IQ: 6. 
The instructions for the search 
screen were as follows. SS#: 
(the two periods are typed in 
this field tell the program to 
include all non-blank entries 
in this field in 
the search; PVRC: Y (the Y 
indicates that an exact match 
is required), B'V: 26.. (thf? 
26.* indicates that an exact 
match is required for the first 
two digits in this column 
and the two periods indicate 
that all non-blank entries 
after 26 are included) . 

The results are a list of 
the 15 clients who were 
placed by the VRC and who were 
closed from the TRC caseload 
as successfully employed (these 
variables were used to sort the 
records, but were not printed) . 
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Table 1 



Tabl<i 2 



VRC Placed and Sucessuluily Closed 
Clients 



DOB 
66.6.9 
64.4.2 
64.3 
63.3 
63.2 
61.8 



TW 
4.0 
5.0 
3.5 



61.11.17 

59.4.13 

58.3.7 

58.3.15 

57,9.12 

57.11.23 

.3r 22 

,1.4 
.7.31 



12 
12 
4 
2 
8 
5 
11 
13 



0 
0 
0 

0 
,0 
.0 
. 0 
.0 



50. 
50. 
44. 



5.0 
7.0 
13.0 
10.0 



3 3 
3 0 
20. 1 
22.8 
19. 0 
20,2 
21.6 
27.6 
25.8 
25 
23 
22 
35 
34 



IQ 

75 
69 
59 
40 
55 

114 
66 
69 
56 
7^ 
62 
46 



38 .9 



Count : 
Average : 



15 
7.6 



25.0 



66 



Table 2 was created with the 
following report order and option 
instructions. SEX: 1 R SC (repeat 
instructs che program to repeat 
duplicate variables, which does not 
normally occur in column one; sub 
coun*: produces a frequency subtotal 
when the data in column one changes 
and a frequency total at the end of 
the column), YE: 2 A (average the 
column), AA: 3 A (average the 
column), PVRC: 4 I (invisible), ST: 
5 I, TRC; 6 N A (numerical, treats 
thit data in this column as numbe s 
instead of text) . The search 
instructions are SS#: (^11 
records that are not blank in this 
field;, PVRC: Y (exact match, only 
records with y in thisc fiel( 
included in the list), ST: 26. 
(exact m'xtch, only records 
entries begining with 26 
included in the list. 



are 

with 
are 



VUC V 


lacod and 






Pi 1 o nt* c; hv 


Gender 


SFX 


YE AA 


TRC 


F 


1 6.00 


2, 600 


F 


11 6.80 


1,995 


F 


12 2.30 


2, 111 




Count: 


3 



ly 



M 
M 
M 
M 
M 
M 
M 
M 
M 
M 
M 
M 



8 
8 
10 
10 
11 
12 
12 
12 



0.08 
1.00 
1.60 
4.00 
6.30 

10.60 
6.30 

12.90 
9.40 
1. 10 
2.70 
3.00 



Count: 



5, 390 
4 , 191 
9,587 

3 ,431 

2 , 288 
1,698 
3,237 
9,880 
4,336 

4 ,408 
2,742 

3 ,384 

12 



Count: 



Average: 
10 



4.94 



15 
4 ,085 



crosstab (crosstabulate) 
reports are created in a 
similar fashion by selecting 
three variables- The first 
variable to use as row data , 
the second variable to use as 
column datr^ and the third 
variable to summarize. 

Table 3 is a 
crosstabulation of years of 
education by sex. The report 
instructions SEX : R ( row , 
indicates that this variable is 
the data used for the rows) , 
YE: C S 

<5; 5->12; >12 (column. 
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indicates that uhis variable is the 
data used for the columns; summary 
(S), indicates that this data will 
bo summarized for each cell), The 
groups <5; 5->l2; >^2 instructs the 
proqram that the data for YE is to 
be grouped, in this case less than 
5, 5 to 11.9, and 12 or greater. 
The search instruction, SS#: 
instructs the program to include all 
records with data in the SS# field. 
In addition the program provides the 
option to summarize the cells in 
several ways. The summary function 
may be a total, count, average, or 
the maximum or minimum values of the 
data. The cells may be displayed as 
numbers, percent of total, percent 
of row, or the percent of column. 
In this case the summary function is 
count and the cells are shown as 
numbers . 

Table 3 



Crosstabulation of Years of 
Education by Sex 



Table 4 



SEX 



F 
M 



<5 



YEARS OF EDUCATION 
5 -> 12 >12 



1^ 
20 



15 
24 



Count : 



34 



39 



32 
46 



78 



Table 4 was created using the 
same cross tabulation instructions 
as Table 3, except that an exact 
match was mandated for the variable, 
PVRC. The search instructions 
indicated that only clients placed 
through the VRC were to be included 
in the crosstabulation. 



CROSSTABULATION OK YEARS OK 
EDUCATION BY SEX, PVRC 



SEX 

F 
M 



YEARS OF EDUCATION 
<5 5 -> 12 >12 



1 
4 



Count: 
5 



2 
8 



10 



0 

0 



3 

12 



15 



SUMMARY 
Program evaluation is an 
administrative function that 
permits the comparison of an 
organization's objectives with 
its performance . it is 

beneficial to the clients 
served, 

the staff of the facility, the 
referring sources , the local 
community in which the 
organization is located and the 
accrediting body which 
furnishes the standards by 
which the facility must 
operate. The purpose of 
program evaluation 
is to make needed improvements 
in the types of services 
offered and the quali' of 
those se rvices ; as they . ilate 
to the mission of the facility. 
File management programs 
are designed to store 
information* This information 
can be in the form of 
numbers, text or a combination 
of numbers and text . The 
information stored in this kind 
of proc am can be retrieved in 
a variety of combinations . 
While not suitable for 
statistical treatment of data, 
this type of computer software 
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is appropiiate for a program 
evaluation and staff performance 
monitoring system. Burton (1986) ^ 
states, 

"communication not number crunching , 
is the ultimate strength of 
PFS. .organization and data 
management form another strong suit 
of the series" (p. 3) . 

Usually referred to as card- 
file managers, a file manager is a 
data base program that does not have 
a defined length, it expands as 
necessary as each record is added. 
Fields are created by typing a name 
on the screen followed by a colon. 
The type of data for each field 
nannot be indicated and the program 
does not monitor the type of data 
entered. This is a limitation 
because if text is entered 
into a field defined as numeric data 
the error will not be detected by 
the program as in the can of more 
sophisticated data base programs 
(Desposito, 1987) . 

Records can be searched for by 
a) exact match, the exact data in 
the field; b) partial match, data 
that ends with, begins with or 
contains the desired string c) 
relative match, data that is less 
than, greater than or equal to the 
desired string; or d) negative 
match, which searches for everything 
but a particular partial or relative 
string (PFS: Professional File 
Manual p* 1) • 

Program evaluation can be 
automated to varying degrees by the 
use of a computerized data base 
system. This allows increased 
accessibility to the data, both' in 
terms of speed and the ability to 
relate variables to each other. 

Increasing the efficiency of 
the program eva I ua t ion report 
reduces the corsts and allows for a 
more systematic and timely 
evaluation. Several funci*ions 

recieving immediate benifits from an 
automatnd system are staff 
performance reviews, quarterly 
reports, marketing functions and the 



ability to share results '^rth 
other rehabilition facilit- s. 
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TIIK Nl-W CAMI-PI.AN FOR VOCATIONAL EVALUATORS- 
BUSINl-SS & INDUSTRY NEEDS YOU! 



ANN WTLIJAMSON 



ABSTRACT 

The sport of football offers a lesson for voca- 
tional evaluation experts: you can't be suc- 
cessful with simply a good defense. New 
OFfensive moves are becomming a necessary part 
of the yoc rehab process, and that new gameplan 
now includes adding evaluations of the non- 
disabled for business and Industry to preent 
programs. 



Vocational experts hist.or:cally have had 
two uphill battles: (1) m court depositions, 
establishing prior performance levels of clients, 
and (2) in rehab placement, convincing employers 
that their Judgment is sound about the employe^ 
value of persons with disabilities. Now, in 
addition, the medical and educational fields are 
beginning to take some of the client potential, 
If not some of the expert staff aa well. It is 
time to launch an offense for survival. 

The new offense begins with a sound evalu- 
alion prucus.s dcnLfinod for ihc nun^d isjl) led cm- 
ploytie of business and industry. Your expertise 
not only iu desparately sought after by business; 
you are the only profession that could provide 
. leadership to the miscellaneous groups of pro- 
fessionals and non-professions who are trying to 
figure out how to provide good evaluation ser- 
vices for which they are handsomely paid. 

What would be your reward? Besides more 
money, you have the toe-hold to solve the two 
problems ment;loned. By testing non-disabled 
employee performance potential, you «re able to 
document prior performance levels and losa of 
functioning for Worker »s Comp and PI cases. (As 
It turns out, this is a dynamite selling point 
to buBlness also!) And you have established 
yourself with business clients as the community 
expert for accurate assistance In the hiring of 
employees— disabled and non-disabled alike. 

Following are the key partlculr.rs of the new 
offense, I have volumes n?ore information than I 
am presenting today, and can be reached later if 
you're interested. 

I. Whnt kinds of testing doo« busin-ss commonly 
require of employeees now? 
(a) drug & alcohol (b) physical (c) AIDS 
(d) polygraph (e) performance & ability 
ANSWER! Only polygiaph testing is no longer 
used, having tecenrly become illegal; paper/ 
pencil honeoty'* tegting has replaced it. AIDS 
testing is HOC recommended, since the condi- 
tions pose no threat to the workplace. Per- 
formance testing is now gaining in popularity 
since a hiatus of about 20 years, during which 
time it was thought to be iUesal or at bast 
Imposflible due to the EKOC, 
2. What types of perf ormance-b^sod tegcing are 
popular with business' KR personnel? 
(a) physchological (b) work samples (c) apti^ 
tude (d) performance/ability (e) intelligence 
(f) interests (g) 'notivational 
ANSWER: All of the above except interest tc.ts, 
which buwinesfe tinda of little uae for their 
purposes. Even intelligence testing of sorts 
is now being triad, in spite of being out ot* 
favor for owhile from lawsuits in the '60h. 
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Some HR staff, however, do not like the l.erni 
"aptitude testing," so the terms is not com- 
monly used* 

3. Why is performance-based testing becoming 
popular? fa) legal problems in hiring/firing 
create a need for more information prior to 
hiring (b) business competitiveness and in- 
creased need for productivity 

ANSWER: Business feels its hands are tied 
(by EEOC regulations) trying to find out be- 
fore hiring whether the candidate will work 
out: . It also feels the pinch of foreign com- 
petition's gain of the world's production, 
and desparately needs ths?. most productive em-- 
ployees for the wage. Performance testing 
provides the most objective data and the now 
legal solution. 
' A. Statistics say that 75% of the workforce of 
the year 2000 are already employed toda'* , and 
that most of them will take new jobs that re- 
quire re-t:raining several times before retire- 
ment. How many people are employed in the US 
today? 

(a) 75 million (b) 1?.0 million (c) 210 million 
ANSWER: (b) 120 million. By the year 2000, 
there will be a 210 million workforce, pri- 
marily composed of seasoned workers, rather 
than today's majority of entry-level workers, 

5. How much money do businesses soerd annually 
on training? 

(a) $100 million (b) $50 billion 

(c) i?200 billion 
ANSWER: (c) $200 billion and rising— due in 
large part to the poor education of incoming 
workers, but also because of new technology 
and revised job requirements. Most training, 
at the present time, is thrust upon employees 
without anyone's knowledge whether the person 
is able to handle either the new training or 
the new job position. 

6. How much money annually, estimated by tbe 
few businesses thac provide performance testing, 
is saved from their training budgets b cause of 
the testing? 

(a)lO% (b) 20% (c) 30% (d) AOX 
(At today's cost of $1650 average spent each 
year on every employed person In the US, that 
would mean more than $660/employee saved — 
after testing costs!) 

ANSWER: Forty percent savings (d) in training 
budgets when perfornjance testing precedes the 
training! What this meatus for the vocational 
evaluator/counselor is there's a lot money 
available for the vocational expert who pro- 
vides assessment- services to business! 

7. What type of training programs are common in 
HR settings? 

(a) anagement /superviHory (b) communications 
(c jmputer use (d) sales (e) safety 
(f; robotics 
ANSWER: All of these t^re common training pro- 
grams (rcmeir* er that (b) is remedial reading 
and arithmet cs) . Computer uhg (c) can vary 
widely, from trnLnlnf, djt.i entry opcrati^rs i.o 
cyc'cutlves, This list should be kept In mind, 
however, when approaching busincsa with an 
ajjsossmenr propo.sal; It is not aR tnt crest cd 
in cnt ry-lovol or facLory ir.iinin}* pro^'.raiiis. 



What general type of employee does business 
believe it wants? 

(a) highly-motivated vS) the smartest 
(c) flexible attitude 

ANSWER: The voc rehab field will be amazed to 
know that business believes it should hire 
only the smartest people it can find! In re- 
sponse to a Fortune magazine article on this 
subject, this speaker was able to get a letter 
of rebuttal published in the next issue that 
explained there are job positions appropriate 
to everyone, including the mentally retarded. 
9, When is performance testing fully legal? 
(a) when a rest measures only the abilities used 
on the job; (b) when the test is non-disparate 
to minorities; (c) when any test ic available 
to any person who wants the opportunity to take 
it 

ANSWER: "(b) when the test is non-disparate 
to minorities" is the only present legal re- 
quirement. There have, however, been contests 
and decisions favoring the employee/candidate 
when inappropriate tests have been given (that 
is, the test was not measuring v\at the job re- 
quired). The last choice (c, above) has not 
yet been considered as a discriminatory factor 
in testing, but look for this to happen. There 
are many college graduates taking lover entry 
level jobs just to get a job, and they will be 
pushing for the higher-paying management posi- 
tions. Oddly enough, though, the "non-dispar- 
ate" requirement does not mean "forced affir- 
mative action." If the performance test 
proves to provide well-qualified employees for 
a position, and no minorities seem to pass the 
test, it is accepted that the test is "vali- 
dated" for the ppsition. 

19. What does business mean v;hen it uses the 

term "validated test"? 

(a) construct & predictive vnlLdily (b) recent 
61 extensive norming (c) measures what the job 
requijces 

ANSWER: It is validated when it produces well- 
qualified employees by measuring what the job 
requires (c) , This, of course, includes (a) 
and (b) above, but little mention is made of 
theiu ^perhaps because these terms are not 
generally understood). 

11. What causes legal problems most often in 

employee selection? 

(a) non-normed test:'ng (b) subjective measure- 
ments (c) testing that has a poor linkage to 
job requirements dl) potential employees who 
"make a living" filing lawsuits against buoiner.s 
ANSWER: By far, (b) subjective measurements 
cause most of the legal battles. When objective 
measurements are added, there is little con- 
test. And while them will always be "free- 
loaders," the best defease against possible 
legal action is to keep the candidate happy 
even when he/she is dented a position. 

What is the legai definition of a "handi- 
capped" perrion (per the Chamber of Commerce)? 
(a) one wLLl\ pliys ica 1 /mcni. al disabililics 
(h) onj V o has AIDS (c) ^ne who the employer 
believes cannot perform the tasks involved in 
the job 

ANSWHU: The (Mnployc* decides If the pf'son 
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Is (l;oo) handicapped Cor thu position (c). In 
order to bring a charge of handicap discrim- 
ination, the person must prove that the con- 
dition is unrelated to his/her ability to 
perform the job. Thie definition is one of 
the forces promoting the improvement in job 
requirement definitions. 
13. What are the qualifications of the present 
internal staff which advises management on the 
employability of ah applicant? 
(a) industrial psychologist (b) counselor with 
AB degree (c) long-time personnel staff member 
(d) vocational specialist 
ANSWER: Staffs are being upgraded by earning 
continuing education units, but the local 
business decides what kind of staff is neces- 
sary. If there are any vocational specialists 
cuch as the rehab f ield^requires, however, 
they would be few and far between. 
1^. Does business prefer internal or external 
measurement /advice services for employee selec- 
tion? External, because (a) results particulars 
can't be gossipped and (b) they feel less liable 
legally 

COMMENT: This is a perfect position for the 
private voc rehab organization who wants to 
expand its business. 
15. What types of job requirement "needs assess- 
ments" are now common in businesses? 
(a) determination of salary ranges based on 
broad-based job tasks (b) Worker Comp-based job 
restructuring (c) job task requirements based 
on expert assessment techniques 

ANSWER: Only (a) and (b) are common. If busi- 
ness knew there were vocational experts who 
could provide consultation for (c), this type 
of needs assessment would also be common. At 
the present time, hundreds of articles are ap- 
pearing on proposed techniques to make this 
kind of determination (none from the rehab 
field). 

1*^. What D.O.T. job requirements are universally 
relevant to businesses* job requirements today? 
(n) aptitudes (b) interests (c) personality 
(d) Oata-People-Things (e) physical/environ- 
mental requirements (f) GED level 

ANSWER: Due to the new US service-based econ- 
omy (as opposed to a manufacturing economy), 
much of the D.O.T. 's job requirements are un- 
wieldy or out-of-date for business. Basing 
performance results on worker functions 
(D-P-T*s), however, is acceptable— primarily 
because it is a popular concept with non- 
disabled career counselors, as well as easily 
capable of local re-definition of job require- 
ments. Ccmbining the Data-Peopl.i-Things func- 
tions with GED levels and physlcal./environ- 
raental limitations seems to produce the qual- 
ity of definition needed by business. 
17. What are the conditions under which business 
would welcome vocational experts to do objective 
testing for employOG soiection? 
(a) statement of vocational expert's qualifica- 
t ions 

kb) consulting services to help busiiitiss deter- 
mine job requirements for each job 

(c) performance-based testing inothod which 

.isscssos .my omployrc for ovc«ry \nh in ihc 



US economy, but also gives confideiuial re- 
port regarding specific job and candidates 
in questions (KEY PHRASES TO USE: hidden tal- 
ent, job switching, multiple-tasking, stress, 
candidate satisfaction) 

(d) offer of personnel re-testing, in case of job 
or personal injury, to pinpoint loss of 
functioning due to accident 

(e) expert witness testimony available 
COMMENTS: Your competition will be industrial 
psychologist-based organizations, management 
consultants specializing in personnel problems, 
and miscellaneous pick-up tests which claim to 
solve employee selection problems. Businejs is 
used to the narrow vision that if there is, for 
instance, a job opening in Salem, a sales test 
should be administered; or a Computer Analyst 
position, a computer analyst test. Your re- 
sponse to this should be, ''It is more economic 
for us to test candidates for more than the 
single position, because you may find that some 
candidates for the job are highly capable of 
more than this (or highly qualified for some- 
thing else) and this is to youi advantage in 
the long run.'' Fortune magazine has been car- 
rying article; about some companies that are 
doing job-switching and/or multiple-tasking. 
This means that personnel are asked to do sev- 
eral different jobs alternately, at manage- 
ment's whim, when the production demand calls 
for additional help in one area and less in 
another. For this reason alone, management 
should be aware of the various performance 
abilities of their employees. 

18. What type of performance-baaed assessment 
tool should you have for us in business? 

(a) computer-scored, for fast turn-a'ound 

(b) Data-People-Things based, rather than apti- 
tude-dependent 

(c) handles full range of intellectual function- 
ing (highest to lowest) 

(d) able to assess both non-disabled and persons 
with disabilities 

(e) reports the level of performance expectation 
of the candidate for the job 

(f) mobile, to offer on-site or off-site testing 

(g) primarily group-based testing, for volume 
assessments 

(h) high test-retest reliability 

(i) normed for disabled and non-disabled popu- 
lations 

(j) clinical-based with capacity for layman 
report 

COM>IENTS: Be very careful of the kind of 
assessment tools you use with business. Not 
every rehabilitation-based tool will work, es- 
pecially when you will need to offer a full 
range of assessments— from management candi- 
dates to some potential workers who are men- 
tally-retarded. The only assessment tool this 
speaker knows that is appropriate for all of 
the nhove conditions Ik from Career Evaluation 
Systems in Chicago. Remember, you will be con- 
sidered business' expert for supplying evalu- 
ation information fur all of the tasks they 
have available, as well as the kinds of per- 
sonnel needed to fill the position. 
19. What aro the mlvanl.ap,of; of specialists In the 
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voc roha!) flold 1 ron» tins now gamcpliin? 

(a) more money for programs and staff 

(b) slower burn-out rate for evaluatorn 

(c) bigber profile in tbe community and in- 
creased respect from businesses for place- 
ment acceptance of "the bandicapped" 

(d) higber demand for expert witness testimony, 
due to prior/post assessments that document 
real loss of functioning 

20. What is the "bonus" for society if tbe vo- 
cational rehabilitation field establishes tbe 
parameters for business to use in performance 
testing? Businesses will finally realise that 
placing greater emphasis on satisfying their 
human resources actually produces the highest 
rewards for the company, 

COMMENTS: ASTD and KR staffs are promoting 
this concept, as well as well-kno^^n business 
economists, Only rehabilitation field ex- 
per»:s, however, have tbe (axperr.ise NOW to 
make this work, when all others who are work- 
ing toward this goal are simply busy "re- 
Inventing the wheel." 

Some commonly i ^'i. J;.^^*!^- 

AR — human resource . - ' ' r^rsonne^ 

department staff) 

Communications skills training — remedial read- 
ing & arithmetic 

ASTD — American Society for Training & 
Development 

EEOC ~ Equal Employment Opportunity Commission 
(federal) 

Test — any subjective or objective measure of 

an employee or candidate for Graployment 
Employee selection — hiring 
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Implications of a Systemic Theory of Vocatio:idl 
Rehabilitation on Vocational Evaluation in the State-Fedora 1 

Rehabilitation Program 



R, Rocco Cottone, Ph,D, 
University of Missouri--St . Louis 
Department of Rehavioral Studies, 8001 Natural Rridge, 
St. Louis, Missouri 63121-AA99 



Abstract 

This paper presents the implications of a 
new theory of vocational rehabilitation op 
the process and practices of vocational 
evaluation in the state-federal vocational 
rehabilitation program. A Systemic Theory 
of Vocational Rehabilitation (Cot tone , 
1987 ? Cot?: e & Cottone, 1986; Cottone, 
Grelle & ilson, 1988) is^a comprehensive 
theoretical framework of vocational 
rehabilitation that challenges current 
theoretical conceptions in the field. The 
theory focuses on relationships and how 
relationships affect the rehabilitation 
process, rather than focusing on 
individual traits or abilities as 
of employment. Propositions 
from the theory are briefly 
including how relationships are 
analyzed, and categorized as 
they influence tne rehabilitation process. 
Special attention is given to the triadic 
relationship structure (counselor 
evaluator - client) of vocational 
evaluation in the state-federal system. 
Implications include: (a) reordering of 
the rehabilitation/evaluation process to 
focus on interpersonal relationships; (b) 
deemphasizing individual traits and 
abilities as predictors of rehabilitation 
decisions or outcomes; and (c) methods for 
obsorvin|> and assessing tiie effects of 
f^ystems of relationships on client, 
counselor, and evaluator behavior. 



predictors 
resulting 
described , 
identified , 



A Systemic Theory of Vocational 
Rehabilitation (Cottone, 1987) is a 
relational theory of vocational 

rehabilitation. Relationships, and not 
people, are the focus of study. In fact, 
the word systemic derives from the idea of 
a system being a network of relationships. 
Because relationships are best viewed in 
the context of the larger relational 
systems within which they exist, the term 
"systemic" is used in the name of the 
theory rather than "relational." 

Some people are quite perturbed by 
the idea that relationships should be the 
focus of study and treatment in vocational 
rehabilitation. After all, the focus of 
study in vocational rehabilitation has 
historically been the individual with a 
disability . From an extreme systems 
theory perspective, however, people do not 
exist as individuals. To the extreme, 
people are simply perceptual phenomena for 
the transmission of relationship. 
According to systemic tenets, 

relationships are what is real and what 
.controls us, even though relationships are 
invisible. After all, we are born of 
relationship, i. irtured in relationship, 
and educated in relationships. We 
represent every relationship that preceded 
us genetically, ns vo at birth arc linked 
to our mothers, fathers, and a social, 
system that sustains us. Everything we do 
reflects the relationships that produced 
and maintain us . 

According to a systemic theory of 
vocational rehabilitation, when we talk 
about vocational evaluation in the 
state^federal system, we are talking about 
assessment of an individual within a 
relational context . Specifically, the 
counselor - client relationship and the 
evaluator ~ client relationship 
important. To understand the workings 
vocational evaluation it is important 
understand that relationships are quite 
distinct, but not necessarily unique co 
the individuals who play the roles. I' is 
reasonable to conclude using sv',cemic 
tenets that many counselor - 'client 
relationships and evaluator - clienr*. 
relationships operate under similar 
contraints . and that outcomes are 
predictable based on the rules nnd roles 
plnyed out in the larger rehabilitation 
system, as opposed to what any one 
individual thinks or does. Consequently, 
counselors and (^valuators have very little 
frtuulom, n« they nro cnught in a wel) of 
relationships that ^itfocts what they do, 

^'iBuro 1 graphically depicts the 
counselor client relationship at the time 
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FIGURE I 

r.hat a client^s applies for services. To 
the left is the rehabilitation system, 
which is represented by the pentagon of 
which the counselor is a part. To Ihe 
right is the client's system of 
significance, that is. the social network 
to which the client is socially t'^^^J* 
The counselor - client relationship 
represents a link between two systems, and 
according to basic systemic tenets . i f the 
systems do not interlock well (a bad fit} 
then the relationship between the 
counselor and client will »>%^«J^^;"«; * 
Bad fit. systemically . means that at tne 
Informal. nonverbal. and "ntex ua 
levels. the individuals are ^/fP^^^^^^ 
;ather than attracted. It would be he 
equivalent of asking a K u /lux KUn 
niember to cooperate with a black activist , 
even without verbal communication, the 
nonverbal behaviors could easily escalate 
in this situation into a disagreement or a 
fiflht. According to a systemic theory ot 
vocational rehabilitation. a vocational 
evaluator will be called to play a 
homeostatic (balancing) role when the 
counselor and client systems do not 
JSterlock well. The evaluator's presence 
then changes the re la t iona 1 s y s t em from a 
dyad (counselor ^ client) to a triad 
(counselor - evaluator - client). ^>ee 



figure 2. 




FIGURE 2 

Triads are very important to a 
systemic theory of vocational 

rehabilitation, because triadi allow for 
rejection of a client based on a two 
against one configuration. that is the 
counselor and evaluator against the 
client. What this means is that clients 
can bo potentially scapegoated If they do 
not piny by social rules consistent with 
the rehabilitntinn delivery system. 
Theoretically, there nre only two possible 
balanced oiJ^-comes within the triadlc 
vocational evaluation configuration in the 
state-federal system: (a) continuing 
rehnbil itation ; or (b) sc a pe gon t i n (see 
Cottone ^ Cottone, 1986, for tho 
theoretical reasons this is so). What 



this means is chat clients ore primarily 
screened-in or screened- out 

rehabilitation primarily for social us 
opposed to vocational capability reasons. 

If vocational evaluators, on the 
other hand. are too accommodating of 
clients that continually break the social 
rules of the rehabilitation system, the 
evaluators do so at the risk of being 
scapegoated by the counselors who are 
their referral sources. ^valuators act in 
order to survive in the rehabilitation 
system, where survival is probably better 
understood as how well they follow the 
rules and regulations of the system to 
which they are dependently linked. 

Given these constraints. and 
understanding that relationships are 
invisible, how does this operational ize at 
the level of vocational evaluation in the 
state federal vocational rehabilitation 
system. Well first, it must be understood 
relationships are best reflected in 
interpersonal communication, and it is the 
informal. nonverbal. and contextual 
messages '.h«t make the relationship clear. 
For exair.j)le. in a college classroom, a 
college professor stands before his or her 
class at a lecturn, professing on a 
subject, while students diligently sit 
attentively taking notes as they seek 
degrees to help them survive in an 
education -era zed culture. What is 

important from a systems perspective in 
this scenario is that most students know 
how to play their role without someone 
explicitly stating the rules. They know 
they can ask intelligent questions, but 
they know that they must not openly 
challenge a competent professor, lest they 
challenge the authority so clearly 
communicated in the nonverbal and 
contextual cues. College professor often 
characterize the perfect student as the 
quiet student who asks intelligent 
qi'.^tions in a timely way, who makes eye 
contact, and who aces every test. The 
worst thing that can happen in a classroom 
is to have a socially inopt student wiio 
continually ignores the nonverbal and 
contextual cues and upsets the balance in 
the classroom. Unless the rest of the 
cla ss helps to s cape oat that socially 
inept person no n verb ally, the semester 
will probably turn into an uncomfortable 
one for the involved i.ndivi duals. A real 
problem arises when the inept person r,itR 
in the front row, where the nonverbal 
class messages are not noticeable, or when 
a client is so socially disturbed that he 
or she does not understand the social 
cues. 

As hinnans wo are very adept at 
recognizing socicH dcvinnce, unless we are 
socially i n e [) t ourselves. In fact, I have 
hypothesized that the vocational 
rehabilitation s y s t e it is n o t h i n \\ h u t a 
m n s s i v e sere e n i n i lu; t i. u u i o n f o r 

screening social deviance. Given a 
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'y I r.\ i(Mn. , .1 (Usnbi lily i 

does not affecn soclcil interaction or only 
affects it rn i ii i mn 1 1 y , and n person who has 
a minimum level of vocational competence 
for succosnful completion of joh tasks, 
and I will give you <; 26 closure. Give me 
100 socially inept clients, clients who 
have body odor, ignore rules of proxemics 
when addressing others, dress in bad 
taste, and continually challenge what is 
socially acceptable, and, no matter what 
their level of skill, I predict 99 of them 
will either not get employment or they 
will not maintain employment over 6 
months. In fact, research shows that the 
reasons that people lose jobs most nsurlly 
involve social factors. Try to fire a 
professor because he or i5he is incompetent 
in the classroom ... almost impossible. 
But its easier to get rid of the professor 
who is the social deviant, who bruaks the 
rules of social decorum with students, or 
who is a constant pain in the neck to his 
or her colleagues. That person will be 
chased out ... sent to acade^iic Siberia, 
*?o to speak, 

I am convinced that vocational 
evaluators are not evaluating vocational 
competence. I am convinced that they, for 
the mosc part, are simply judging clients 
on their social abilities within a 
vocational context and screening in the 
most socially skilled, Those that are not 
«ocvallv skilled are recommended for work 
adjustment. In fact, with several of my 
colleagues I published a paper last year 
(Cottone, Grelle & Wilson, 1988) which 
supported the contention that the 
decisions of vocational evaluators working 
with psychiatric clients could be more 
accurately judged on the basis of social 
interpersonal evidence in their reports 
than on the psy cho 1 og ica I / voca t iona I 
evidence in reports. In effect 

evaluators spend hours and hours testing 
clients with ^'objective tests," and then 
when It comes down to the "nitty gritty " 
they recommend .raining/job placement for 
those with social skill that played by the 
rules, while recommending work adjustment 
training or case closure for those who 
where socially inept or broke the rules, 
Jitythe poor client who doesn^t learn 
after being sent to work adjustimcnt 
(purgatory) to play hy the rules. For the 
system will tell him or her where to go! 

It is my contention that beyond some 
minimum level of competcMicn nt job relatcMl 
l:as<s, it is social/intcrp(»rsona] skill 
that predominates in 'he work place. And 
since most vocational evaluators work wj th 
clients «t the lower cmuI of the .skill 
spectrum (fno.st college bound .studcMits are 
not evaluated), s oc ia I /i n ter pe rsona 1 skill 
should be a major concern and the focus of 
evaluation. Think of the money rha^ can 
l)e saved in the s t a t e- f ed e r a 1 systpm If 
evaluators would focus on what rhey are 
primarily evaluating nnyway! Why | ] 

this testing needed when i n ^ n 



j)r () b.i I) i. li t y il play:. .i c on d ,i r y i o 1 c in 
final decision making? l,ctVs begin to 
1 0 0 1< at how c I i e n t R fit socially in the 
network of relations to w h . c h they aspire. 
LetVs begin to focus on training 
individuals to understand social/ 
inter per<:ona I rules and to follow 
reasonable social, standards? Let's stop 
ma squ era ding a massive social screening 
system with a psychological and vocational 
assessment process. 

Discussion 
The implications of a systemic theory 
of vocational rehabilitation on vocational 
evaluation are as follows, For greater 
detail on tlvjsc issues see the article by 
Cot tone and Cottone (1986) which addresses 
the same issues. 

1, A systemic theory of vocational 
rehabilitation provides a different 
perspective of vocational evaluation. 
This perspective is more holistic than the 
reductionistic psycho medical paradigm, 
because it accounts for influence of 
networks ^f relationships on behavior* 

2, The focus of attention in 
rehabilitation changes from individuals to 
relationships. SystemicaUy, people are 
not analyzed, but the relationships 
between them are analyzed. For example, 
clients who establish negative 

relationships with their counselors, who 
additionally are not able to show clear 
evidence of social capability and socially 
acceptable goals, will likely be 
sea pe go a ted . Accordingly , the 

rehabilitation system will maintain itself 
at the expense of clients who severely 
deviate from social standards. 

3. Since social relationship skills 
take precedence, evaluators should define 
social relationship skills at an early 
phase of the evaluation process. The 
present emphasis on results of 
psychological testing and work sampling is 
vocational evaluation 's greatest 

deception, Unless the client can 

demonstrate the strong potential for 
social relationship skill in the early 
phase of the vocational evaluation 
process, the assessment of other skills is 
a wasted effort. Vocational evaluators 
have much to learn from marital and family 
therapists in this regard, since marital 
and family therapists have been developing 
ways tn asses:^ relationships within 
Counseling settings. 

^t. Psychological terms, such as 
motivation," need to be redefined from a 
systemic viewpoint. For example, 

moti vation , wiiii in the framework of a 
systemic theory of r nha hi M tat ion , is the 
degree of cngagcMnont of two interacting' 
.systems, as viow(M! from the perspective of 
cne of the systems. Hence, "motivation" 
IS placed in a relational context. This 
ir. also true of skills or traits (r.uch as 
intelligence). Since traits are measured 
in relationships, thoy are not devoid of 
re 1 n I i on;\ \ \ u [ \ ucncps . 



98 



NATIONAL FORUM 



'■) , Voc. M L L oiifi 1 o Vii 1 ii.i r 0 r s nmsl I earn 
ways to nffect tho counselor - clioni 
rola t ionshi. |) nnd the client. '.s 

relationships with any systems o( 
inlluence that dc not interlock well with 
the rehabilitation system. Methods must: 
also be developed to analyze objectively 
the sy: Lemic influences f botli the client 
and rehabilitation systems. Again, 
evoluators would be served well by 
studying developments in the field of 
marital and family therapy for guidance on 
these issues. 

6. Vocational evaluators should 
thoroughly define the critical social 
relationship skills necessary for 
obtaining and maintaining employment. 
Specific criteria and procedures should be 
developed for assessing a client 
capability to perform the critical social 
relationship skills necessary for 
obtaining and maintaining employment. 
Techniques for social skills training 
(e.g.> L'Abate Milan, 1985) should play 
a prominent role in vocational evaluation 
and> subsequently > work adjustment 
training. 
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WHAT WAT IS AND WHAT WAT IS NOT 



KAREN PKLt AYSLLA 



ABSTRACT 



..w adjustment training, condensed 
li^^ \ acronym WAT, has been a critical 
element of rehabilitation services for 
many years, with the shift of policy and 
funding to community based services. wAT 
^H^n labelled as one of several 

"dinosaurs" of rehabilitation. its 
history has been facility-linked, so that 
ilii;^<®"f^ ^° dismiss- its theories, 
principles, and practices as 

ioh^Sf?^f^?t"^ contemporary vocational 
rehabilitation efforts. 

From a brief review of the history 
of work adjustment, this commentary 
discusses the generic elements of work 
adjustment that apply to all services 
which adjust persons to work. These 
include behavior management, task 

accomodation and 
restructuring, learriing assessment, and 
work management. Their uniqueness in 
renabil itation service delivery is 
presented, as well as the identification 
of persons best able to benefit from 
"Jfr^ services. Strategies and 
modalities of "best practice" are 
presented, with greatest emphasis upon 

nJfnfiSi"? those persons best able and 
prepared to practice. 

nh«o^,?D?^<"*^°"^ "P°" field 

discussions with 
practitioners. Questions are raised to 
challenge the audience to consider the 
fS^vf^ implications of this important 
service to persons with disabilities. 



The definition ot work adjustment 
which was generated by the participants 
of the a -nth Institute on Rehabilitation 
Services in 1972 has served the 
profession well for the last sixteen 
years. Tha definition boars repetition 
at this time of reappraisal and 
reinterpretation of rehabilitation 
services. Work adjustment is a 

"systematic treatment or training 
process utilizing individual and 
group \io^K or work related 
activities to assist individuals to 
understand the meaning, value, and 
demands of work, to modify or 
develop attitudes, personal 
charftoteristics and work behaviors, 
anrt to dev&lop functional capacity 
to assist the client to his optimal 
level of vocational development" 
(Tenth Institute, 1971 



An informal survey conducted by this 
author of practitioners and students in 
master's level rehabilitation courses 
support the viability of work adjustment 
u*.-. component in the successful 

rehabilitation of disabled individuals. 
It remains the primary treatment 
recommended for disabled individuals who 
are not yet ready to enter the work 
force. However, with the documented 
success of related services such as work 
hardening and supported employment, it is 
time, and it is hoped not too late, to 
reexamine several aspects of work 
adjustment. These include identification 
of those features which make it unique, 
those persons who are best able to 
benefit from its services, those 
strategies and modalities which have 

no?^on«^°>, """f^ successful, and those 
persons who are best able and prepared to 

From such an 

appraisal of the profession, it is 
possible to determine the "state of the 
^ ^ course of action for 
practitioners and researchers, those 
persons who identify with and '..ppor? 
n?in P"'«s\i°"- It is hoped that sSch a 
Plan will strengthen and facilitate the 
development of this field to ensure its 
continued presence as a service option 
for rehabilitation services to 
individuals in the years ahead 

adnustTot"^*'"^"'''''^^ perspective, work 
adjustment was idpntifipd 

rehabilitation during the 'Vos^nd 'eos 

along with the rehabilitation facility 

movement At the same time federal 

legislation autliorized environments whexi 
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this service could be provided. Sawyer 
(1988) and Pruitt (1983, 1988) both have 
recounted the history of the profession* 
They trace the roots of work adjustment 
from occupational therapy, learning 
theory, and behavioral psychology. 

Currently, the tendency is to assume 
that the *<new** dimensions of work 
hardening and supported employment 
Integrate easily into work adjustment 
ser>^ice8. Yet, it is important to 
remember th^it the terminology, the 
principles of practice, and the 
professionals who support it have been, 
are, and, it can be argued, will remain 
linked to vocational rehabilitation. 
That linkage implies strong ties to the 
public funding streams, to clientele 
linked to that service delivery system, 
and to legislative mandates which shift 
according to federal initiatives and 
priorities. Such linkages can create 
major barriers to a general acceptance 
and understanding that work adjustment is 
a generic service common to all programs 
which target the adjustment of persons to 
work. 

UNIQUE FEATURES OF WORK ADJUSTMENT 

The fundamental elements of work 
adjustment upon which practitioners in 
work hardening, supported employment and 
"traditional" work adjustment services 
agree are: 1) that work adjustment is an 
individualized training process that is 
ongoing and occurs over time; 2) that 
the emphasis is upon treatment of work 
behaviors more so than skill deficits, 
which distinguishes it from occupational 
skill training; 3) that the modality of 
work or work related activities is a 
unique feature that distinguishes work 
adjustment from other adjustment 
services, such as social or community 
adjustment activities; and 4) that it is 
goal-orien\.ed, in that the treatment and 
training should target specific behaviors 
and prepare the individual for work or 
work training, such as a formal skills 
training program. 

It is important to note that these 
features are not setting-specific 
(medical , rehabilitation, community- 
based, or educational) nor funding- 
linked. The primary emphasis is upon the 
person and work, be it a specific job or 
more general work experiences. These two 
key elements form the foundation of the 
Minnesota Theory of Work Adjustment 
developed by Lofquist and Dawis (1967), 
which postulates that the congruence of 
job satisfaction and job satsif actoriness 
ensures job tenure. This means that when 
a person's needs are reinforced by a job 
and that job's demands are met by the 
person's efforts, then there is balance 
and longevity on that job. 

The goal of this model, and of all 
work adjustment programming, should 



equate job success with job tenure 
(Pruitt, 1988, p. 69). Pruitt emphasizes 
that the only successful outcome of such 
services is successful competitive 
employment. His voice joins those who 
support both work hardening and supported 
employment. Tl^ey, too, maintain that 
entry or return to the competitive labor 
market is the only successful outcome in 
vocational rehabilitation. 

This pragmatic outcrme may be 
difficult to accept anc' promote for 
proponents of a more life enriching 
interpretation of rehabilitation in 
general , and adjustment services 
specifically. The language of work in 
the title "work adjustment" must target 
work as the goal, which becomes the 
positive or desired outcome of work 
adjustment services. Personal, social, 
educational, and community adjustments 
are important as an extension of work 
adjustment, in that success in any or all 
of those areas enhances success in work 
ad j ustment a nd visa verssa • However , 
success in any one or all of those areas 
without success on the job is 1 3s than 
work adjustment, and should be labelled 
as something else. It may be called 
psycho-soc ial adjustment , community 
ad j ustment , or avocati onal ad j ustment . 
The goals are different. Work may be a 
treatment intervention, a modality of 
change, a classroom experience. However, 
if it is not the goal, it is not work 
adjustment. 

Yet, the caution is not to equate 
work adjustment with an expanded concept 
of job matching. Work adjustment is not 
matching one person to one job. 
Comprehensive work adjustment should 
include dimensions of career development, 
self appraisal, interest and job 
matching, and job seeking skills training 
to ensure that an individual can enter 
and move within the labor market. It is 
ludicrous to believe that all individuals 
with disabilities remain in ^he same 
positions for their working lives, that 
they do not aspire to loftier positions, 
that they do not seek to change career 
paths at some point, and that they want 
to return to formal rehabilitation 
services to achieve these career moves. 

The onus is upon the work adjustment 
professional to teach the skills which 
can empower an individual vocationally 
throughout his or her working career. It 
is incumbent upon the profession to 
expand the scope of the outcome measures 
to include those that ensure "career 
adjustment," meaning a measure of job(s) 
success over time. Research should be 
undertaken which is longintudinal and 
looks at job satisfaction and job 
satisfactoriness in broader terms than 
tenure on one job. 
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INDIVIDUAL BENEFITS FROM WORK ADJUSTMENT 

It is common to identify clientele 
for a particular service initially by 
matching individual service needs to the 
dimei sions of the service available 
Over time, the individuality of that 
person and service is generalized to 
setting and funding streams, it appears 
that all persons served by a particular 
program get the same service whether they 
need it or not. Plans identify and target 
the same behaviors, treatment involves 
the same interventions, and outcomes 
follow the same patterns. Do all persons 
with developmental disabilities seek, 
enjoy, and feel rewarded by work in food 
and janitorial services and horticulture? 
Too often, it is the dimensions of the 
work adjustment program (its staff 
expertise, its in-house and community 
vocational resources, and its referral 
sources) which shape the work adjustment 
service, and not the work adjustment 
needs of the individual. 

Work adjustment suffers at present 
from Identity problems. Matheson (1988) 
accurately describes work adjustment as 
focused on providing services to 
individuals with developmental 

disabilities to assist these disabled 

individuals to adjust to a work setting 
and accept :he values and interpersonal 
demands of uch a circumstance" (p. 73) 
There wa. and is little, if no* 
acceptance by persons with other 
disabling conditions to being served in a 
setting with developmentally disabled 
clientele. Their work adjustment needs 
may be the same, but there is great 
resistance to being served in the same 
environment. 

One commmon explanation for this is 
that persons served in work hardening 
programs see their disabling conditions 
as temporary and as not handicapping. 
They do not identify their situation or 
their potential with developmentally 
disabled individuals. work adjustment 
environments, especially sheltered ones, 
frequently have tolerated and even 
reinforced behaviors and work attitudes 
that are not consistent with those in 
competitive settings. The impact upon 
the individual can be detrimental and 
handicapping. This can be vividly 
demonstrated in an educational setting 
when one compares an individual from a 
mainstreamed environment and an 
individual from a self-contained 
classroom, when both have the same 
diagnosis. It is remarkable to this 
author who has observed the differences 
in performance as affected by self- 
perception and self-identity/image; 
further, there has been mirroring of 
inappropriate or maladaptive behaviors of 
others. The impact upon the vocational 
potential of each is significant. 

These issues of isolation and non- 



integration have compelled persons with 
?or disabilities to advocate 

for supported employment options in order 
to integrate into work settings. The 
JoS"H<«^h?^f integration of disabled and 
in "^.P^"""^ place not 

^^®atment environments but at work 
Slues. The risk is that now persons with 
developmental disabilities deal with many 

wSc^. ^I^f ^"^"^ "^"^^ the worksite" 
niv^^>^ deviance in work 

?^^5^f^"°^, ^"^ behavior are minimal. 
Reactions by co-workers may result in 
^"Su*!^ potentially more severe and 

llrL^^^'f^i^- °f isolation than 

persons felt in sheltered environments. 

unr-v i^^ony is that traditional 

ove^ ♦.hi"^^"^"^ services were developed 
dT«^h?^ "^1^ to moderately 

fi^^ni^*^- ^v, ^."^ to a number of 

D?io???0 individuals have a low 

priority at present for funding and 
support. Those persons ranking high in 
priority for services do not naturallj 
fit into the historical models. This 
"retooling" dilemma can be compared to 
the traditional classroom teachinq 
strategy of "teaching to the middle." 
that strategy, the extremes are less 
adequately served, because the content 

^^f ^all^ short Of student 
capabilities. Applying this concept to 
work adjustment, those "middle" persons 
^appropriate for traditional work 
Adjustment services are dwindlinn in 
-^^ .^"^ extreme are severely 
disabled individuals, who were not served 

^o™';^^''f'i^■^y measuring success as 

competitive job placement). Thev 
promoted the supported employment 
placement model, which subsumes work 
adjustment treatment and training 

^°1^ °f the job coach, 
who addresses them at the job site. Th4 
?nH,f^ .^^t^eme, which includes the 
o^H^^l^.^ injured and the economically 
and educationally disadvantaged, do not 
Identify with a severely disabled 
population and ave found othlr 
strategies to adjust to work. For the 

SovfJ^^H"^^^ ""^'^ hardening as 

^ ^" jiob-specific environments is 
the preferred path to return to work. 

These needs are not mutually 
exclusive, in their delivery or in ^-h ■ 
treatment environments . J^e traditiSn.l" 
models of work ad^u«!^n,on♦• 1 p^^aaitional 
not be so riaid ^h«^ services should 

new settin«l that new applications in 

Seveiop'ed.'"^'ltTs"°in. \ 

that c^fent need's' "dr^r^e-^^'thi" 

delivery and not other factor.'^'''''r^ 

adjustment to work is%hl 

environments (or simuiJl^ 

Should be the setting for th"f 

Within these slttiLI ■ services. 

Planning based upo^ cu'ent'^ne^H^^'i'^"" 

determine the specific eJem.nV^ ^ 

adjustment. t^^^-^^J^ic elements of work 
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Idealistically there are a variety 
of persons who could benefit from the 
generic model of wox*k adjustment based on 
the Minnesota Theory, A service model 
which is customized to individual need 
and which is sophisticated in its 
structure and staffing pattern, is very 
costly in equipment, manpower , and time, 
as Matheson laments (1988) . Yet, such 
quality in practice needs to be 
rccogn.lzed and reinforced by performance 
standards from funding sources and by 
credentialing bodies and other regulatory 
agencies. For work adjustment to enhance 
its credibility, its standards and 
outcomes must be high and must be 
closely monitored, 

SUCCESSFUL STRATEGIES AKO TREATMENT 
MODALITIES 

There remains a paucity of research 
and documentation of work adjustment 
techniques • This ab^^ence is reported by 
Sawyer and Morga'. in 1981 and remains 
unaddressed eight /ears later, when the 
profession of work adjustment is in a 
period of reappraisal. The VfiHM 
Bulletin^ the primary publication for 
work adjustment within the rehabilitation 
community, continues to publish articles 
on the process and theoretical bases of 
work adjustment; there is a distinct lack 
of articles on research as to quality and 
effectiveness of process or techniques. 

Persons charged with providing work 
adjustment services continue to report 
that they struggle with identification 
and selection of appropriate and 
effective strategies and treatments to 
meet the needs of their clients. Too 
often, when a client is successful in 
work adjustment, it is not easy to 
isolate and replicate those effective 
strategies to other clients and other 
situations. 

The "shotgun approach" to work 
adjustment described by Pruitt (1983' as 
an historical antecedent is in practice 
with minor modification today. The 
philosophy that "work and work alone was 
sufficient to change unproductive clients 
into productive workers" (p. 13) 
prevailed. Sadly, work still is that 
"panacea" today in many environments , 
both sheltered and competitive. There 
are reports of disabled persons placed in 
jobs, where the adjustment objective is 
to teach the j ob process and not to 
address interests, behaviors, or v<nlues 
of the worker. When the career 
development attributes of the worker are 
not considered in decisions for work and 
work adjustment, inequity results • 

Sawyer and Morgan (1981) focused on 
five work adjustment techniques which fit 
into a comprehensive approach to work 
adjustment services. These are: 
individual counseling; assertive 
training; biofeedback; modeling; and 



microtraining. These five build on the 
parameters identified by Esser in 1977, 
which include counseling (both group and 
individual) ; behavior change procedures; 
modeling; planned work experiences ; and 
instruction (both group and individual) , 
They also apply to the critical job site 
training responsibilities, as described 

in The Supported H^rk Mgd?! 

Competitive Employ ment for Citizens with 
Severe Handicaps; A Guide for Job 
Trainers ^Moon, Goodall, Barcus, and 
Brooke, 1986). JoL trainer 
responsibilities are: assessing situation 
and applying behavior change in^iervention 
strategies (pp. 98-99) ; teaching self- 
reinforce nent techniques (p. 79); and 
teaching job skills through analysis, 
re inf orcement schedules , performance 
records, prompting, and fading (pp. 67- 
75) . 

These relatec^. techniques in 
teaching, training, and treatment, as 
Sawyer and Morgan (1981) summarized them, 
appear in the literature as generic over 
time, setting, and seir/ice needs. Such 
consistency corroborates their 
fundamental role and success in work 
adjustment ser^'ices. If these techniques 
are fundamental to the profession, then 
these should be the fundamental "tools" 
of all professionals practicing in the 
field. 

A preliminary study of training 
needs of work adjustment personnel 
(Gregory. Whitlow, Levine, and Wasmuth, 
1982) indicated that client observation 
was the one technique about which all 
respondents indicated familiarity or 
Knowledge • Group processes , especially 
using peers , ranked high (97%) in 
familiarity and would involve counseling 
skills , although counseling did not 
appear as an independently labelled 
technique • Behavior change strategies 
also ranked high, at 98%, as did on-the- 
job training. Specific learning 
strategies, such as pacing, job redesign, 
and work place layout ranked much lower 
in familiarity, suggesting that knowledge 
of sophisticated job training strategies 
was weak and that these professiona'' 
respondents used modeling and other more 
simplistic techniques to teach job tasks 
to clients. 

There is a gap between the 
fundamental techniques identified above 
and those used in practice, as reported 
by the 1982 study and the more recent 
supported employment literature . This 
gap is widening based on the role and 
training of the practitioner. A job 
coQch or employment specialist as 
described in the literature (Moon et al, 
1986) is not the same as a work 
adjustment specialist as defined by the 
Commission on Certification of Work 
Adjustment and Vocational Evaluation 
Specialists (CCWAVES) . The same may be 
said for several of the professionals on 
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the team described by Matheson (1988) in 
nis work hardening model. Specifically, 
there are physical therapists,' 
occupational therapists, psychologists, 
and even vocational specialists who do 
not have the full range of treatment, 
training and teaching skills needed for 
work adjustment. 

PERSONS BEST ABLE AND PREPARED TO 
PRACTICE WORK ADJUSTMENT 

There is a dichotomy in this 
profession in practice. Work adjustment 
practitioners are concentrated at two 
ends of the spectrum. There are persons 
practicing who are high school educated, 
trained briefly and usually on the job as 
production supervisors and employment 
specialists, who perform "lead worker" 
type roles. By that, it is meant that 
these persons are responsible to perform 
work assigned to their disabled clientele 
as well as to teacn that work to them. 
These persons have been employed in 
sheltered facilities for many years and 
now have colleagues who perform the same 
tasks and responsibilities at competitive 
30b sites. 

At the other end of the spectrum ar3 
the professional level work adjustment 
practitioners; those persons who have 
achieved at minimum bachelor's level 
educational goals and who frequently have 
master's degrees in counseling, 
education, and related human service 
occupations. These individuals, when 
queried informally by this author, 
identify themselves as counselors and 
rehabilitation specialists. They ally 
themselves with counselor-related 
professional organizations, pursue 
certification and continuing education 
opportunities in these areas, and do not 
recognize their skills as particular to 
work adjustment services. 

Such a dichotomy weakens the 
profession. A person who invests time, 
money, and personal energy into pursuit 
of professional standing through 
education, board certification, and 
maintenance of that standing, does not 
want to be viewed as performing similar 
tunctions to a high school graduate. 
Such an allegiance also lowers the wages 
for the profession as a whole, because 
the economy will bear the cheaper 

practitioner if the same outcomes are 
achieved. 

Work adjustment competencies have 
been researched (Pruitt, 1973, Coffey and 
Ellien 1979, Menz (Ed) 1984). m early 
1989, the Commiaaion on Certification of 
Work Adjustment and Vocational Evaluation 
Specialists (CCWAVES) will be undertaking 
a Roles and Functions Study for work 
Adjustment Specialists to refine the 
Knowledge and Performance Areas currently 
outlined in their certification process 
for Work Adjustment Specialists. Current 



Knowledge and Performance areas are: 
Functional Aspects of Disability; 
Situational Assessment; Learning style; 
Behavior Managment; Individualized Work 
Adjustment Planning; Work Management; 
Task Analysis; Measuring and Documenting 
Progress; Functional Living Skills; job 
Modification and Restructuring of the 
Work Environment; Community-Based 
Vocational Training; and Social Aspects 
of Disability. 

The scope of skills required in 
these Knowledge and Performance areas far 
exceeds the level of formal training and 
thi sophistication of on-the-job training 
01: the high school educated practitioner 
described above. Similarly, the 
specificity of these skills demands of 
the master's level practitioner more work 
site applications than counselors or 
educators would encounter in training in 
their respective fields. 

The training opportunities for work 
adjustment specialists are discouraging. 
The University of Wisconsin-Stout 
maintains the only master's level degree 
program in work adjustment. There are 
courses taught in work adjustment in 
several vocational evaluation master's 
level programs. Continuing education 
opportunities are offered sporadically in 
most RSA regions of the country. The 
number of certified work adjustment 
specialists appears to have peaked at 
approximately 500 persons with the 
prospect for increasing those numbers 
through certification and/or 
recertification not promising given the 
present credentialing structure. 

This training crisis holds several 
implications: 

1. that there exists little if any 
federal mandate and '-npropriation for 
training in this area vspecif ically work 
adjustment), and, it is possible, the 
perception of policy makers that little 
is needed; 

2. that the lack of formal preservice 
training programs over the years has 
limited the amount of research, its 
application, and transmittal of skills 
the outcome of which, often, establishes 

J'il^ knowledge and proffissional 
idrntity needed to foster the development 
Of work adjustment as a legitimate 
service system; 

3. that personnel providing services in 
facilities and in the community do not 
describe their skills and job functions 
in the language of traditional "work 
adjustment" services nor do they ally 
with that profession's rubric; 

4. that this inconsistency with language 

identify work adjustment 
leads to confusion as to "what" it 
^"^ t° frustation by 

KJo^fJ"""^ attempting to define and 
generate support for the profession; 

5. that persons who initially souqht 
training/education in work adjustment and 
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that pursued certification in that 
specialty appear not to identify with 
that profession or certification process 
as such any longer. 

SUGGESTIONS FOR PROFESSIONAL RENEWAL 

The time is now for renewal, and as 
with any renewal effort, there needs to 
be a cause, be it a victory or a crisis 
around which to rally. It is the 
expressed hope of many who have 
identified with work adjustment over the 
years that the cause be one of promise 
and of growth toward better practices for 
those served. This cause needs to be 
identified, promoted, and led by a 
charismatic force of committed 
individuals whose goal is to preserve 
this fundaaental vocational service. 
While preserving the service, the force 
of change and renewal should also foster 
the refinement and adaptation of the 
service to meet the complex needs of our 
ever growing and more diverse population 
of individuals in need. This force must 
advocate for more funding and federal 
support, needs to promote the 
generalizabillty of these specialized 
skills to all work environments for any 
and all person?; who struggle to adjust to 
the meaning, value and demands of the 
workplace, as demonstrated in attitude, 
behaviors, and functional capacities. 

When the complex needs of disabled 
individuals are considered, there is a 
body of knowledge and a discrete set of 
skills that practitioners need to have in 
order to serve this special subset of the 
workforce effectively. Those skills need 
to be researched more thoroughly, and 
disseminated to pracitit loners more 
formally. Practitioners need to be 
rewarded financially and afforded the 
professional dignity that their level of 
expertise demands. The certification 
process for work adjustment professionals 
needs to be reviewed to understand more 
fully the role of this process ii- the 
profession as expressed by its 
practitioners. Consideration should be 
given to a nlerarchlcal certification 
process for practit loners , recogn i z i ng 
that certain elements of work adjustment 
are provided by persons with educational 
backgrounds that range from high school 
completion to graduate level degrees. 
Skills in pl/inning, formal reporting, and 
more complex behavior and teaching 
management strategies should be performed 
by persons trained formally and with 
supervised internship experiences in 
those areas. 

It is most important to begin this 
process of review, analysis, and growth 
with the commitment that work adjustment 
is a viable and necessary element of the 
constellation of services provided to 
persons seeking work entry, return, and 
tenure. 



Reference List 



standards 
for certif x< 




CCWAVES . ( 1987 ) . 

procedures n^anual 
in work adi ustment , Chicago, 
Commission on Certification of Work 
Adjustment and Vocational Evaluation 
Specialists. 

Coffey, D. and Ellien, V. (1979). Hark 
adi ustment curriculum devpl ppment 
nrnjftnt-,! A ^ummary . Menomonie, WI: 
Stout Vocational Rehabilitation 
Institute, Research and Training 
Center. 

Couch, R.H. (1984). Basic approaches to 
adjustment services in 
rehabilitation. Journal of Applied 
Reha^il ttatii on C nunselina . .15^0) f 
20-23. 

Gregory, R.J., Whitlow, C.B., Levine, M. 
and Wasmuth, W. (1982). The 
techniques of work adjustment. 

Voc^^tj^pal P|valu^t^^r^ and Work 

Ad Tustment^JBullfitili^ 1&(1) / 5-10. 

Lofquist, L. and Dawis, R. (1967). 
^^j|ia^n.^nt to wny)t! A Psychol oqlcal 
viot^ of man^q yvr^^l^tng in a work- 

9l>i^,ni-^d aooietY. New York: 
Appleton-Century-Crafts . 

Matheson, L.N. (1988). Integrated work 
hardening in vocational rehabilita- 
tion; An emerging model. VQcatl9nal 
^"^^^Mr^t^'^ri ff^^ Adjustment 
B^etin . 21(2). 71-76. 

Menz, F. (Ed). (1984). Work adjustment 
compe^encip-s ; An n<7*-f t-.f d resoi rces 
for training. Menomonie. wi; Stout 
Vocational Rehabilitation Institute, 
Research and Training Center. 

Moon, S., Goodall, P., Barcus, M. , and 
Brooke, V. (19D6J . VUp suttnorted 
wnyk mot^ql o f cQir^petitivQ empjlcj^yment 
for citizer ^p with ff^^ygre han^i^caps: 
A mHr^A for job trainers, Richmond, 
VA : Virginia Commonwea Itn 
University, Rehabilitation Research 
and Training Center. 

Pruitt, W. (1973). Work adjustment* A 
report on a national opinion study. 
Y^ ^^f-ional, F.vAlnat^^n And Work 
ilri- }n«t,T«ent "lp,tln, 6 (2). 19-28 . 

(1983) . 

WI 



Pruitt, W, 

Menomonie , 
Associates. 



pruitt, W. (1988). A response to "Work 
adjustment as a professional service 
in rehabilitation'' by Horace W. 
Sawyer. 

WnpT fti.1Vfft^*^"^- Hulletin. 21(2), 67- 
70. 



NATIONAL FORUM 



Sawyer, H.W. and Morgan, B.G. (1981). 
Adjustn.ant techniques in transition. 

Vocatinn;,! Pw^luatinn «nH yjr.^y 

AdiustTnant^ R.in^i-in ^fi) -'n ~ 

sawyer, H.W. (1988). Work adjustment as 
a professional service in 
rehabilitation. Vocat i nna i 
Evaluatinn .r.A Wnrlc -ITTp^f^j^ 

Bulletin OIJO) Kt;-.= n 

Tenth Institute on Rehabilitation 
Services. (1972). Vocational 
fivalu^ti^p and work art-^nst-m^ 
^" vnr■a;^n».1 
rehqbl-^Tt-;<i-ir.n Washington, DCT 

US Department of Health, Education, 
and Welfare, ^Social and 
Rehabilitation Services, 
Rehabilitation Services 
Administration. 

Thomas, s.W. (1988). A comparison of 
the work adjustment and work 
hardening papers. Vocatinna] 
Evalua-t^inn anH M»r-v 
bulletin . 21(2), 77-80. 



NATIONAL FORUM 
FOUR PERSPECTIVES OF VOCATIONAL EVALUATION 



DEBORAH NOLTE, M.S., C.V.E. 
AKRON PUBLIC SCHOOLS 



Abstract 

The identity and scope of the vocational 
evaluation profession is in a state of 
flux. Vocational evaluation is no 
longer solely identified with rehabili- 
tation facilities for mentally handi- 
capped adults. Four different perspec- 
tives of vocational, evaluation is 
provided from practitioners in the 
traditional rehabilitation facility and 
private practice, school-based, school 
psychology, and occupational therapy 
perspective. 



The purpose oL this general session 
was to provide an opportunity for 
various perspectives regarding the 
profession and practice of vocational 
evaluation to be presented. Noted 
practitioners from four different 
professions provided their opinions as 
to what is vocational evaluation and 
what is unique regarding vocational 
evaluation in that particular profes- 
sion. The general session presenters 
included: Linda Mathias Kaskel repre- 
sented the traditional rehabilitation 
facility and private practice perspec- 
tive of vocational evaluation, Pam 
LeConte discussed school-based vocation- 
al evaluation. The school psychologist 
perspective of vocational evaluation was 
presented by Ed Levinson, Carolyn Baum 
represented the occupational therapy 
perspective of vocational evaluation. 
Each of these panelists had an opportu- 
nity to discuss their perspectives of 
vocational evaluation. Following, the 
audience was asked to identify with one 
of the perspectives and to divide into 
small groups. The purpose f the small 
groups was to allow the audience an 
opportunity to contribute to the pre- 
senter *s comments and to help bring to 
closure the issues regarding vocational 
evaluation from the particular perspec- 
tives . 

It should be noted that the term 
vocational evaluation will be used 
generically throughout this paper. It 
can be interchanged for the term voca- 
tional assessment or vocational apprais- 
al unless specific reference to these 
terms is provided. 

As defined by the VEWAA Glossary 
(1988), vocational evaluation is a 
comprehensive process that systematical- 
ly uses work, either real or simulated, 
as the focal point for assessment and 
vocational exploration, the purpose of 
which is to assist individuals in 
vocational development. Vocational 
evaluation incorporates medical , 
psychological , social , vocational , 
educational, cultural, and economic data 
into the process to attain the goals of 
evaluation. Also defined in the VEWAA 
Glossary (1988) is the term vocational 
assessment . Vocational assessment is 
the comprehensive process conducted over 
a period of time, usually involving a 
multidisciplinary team. . . with the 
purpose of identifying individual 
characteristics, education, training and 



er|c 



106 



NATIONAL rorvUM 



placement needs, serving as the basis 
for planning an individual's educational 
program and which provides the indi- 
vidual with insight into vocational 
potential . 

Rehabilitation Far n i t-y/ Private Practice 

Vocational evaluation is tradi- 
tionally associated with vocational 
rehabilitation and is considered the 
initial step in the rehabilitation/ 
habilitation of adults with disabili- 
ties. Three components are usually 
identified with the rehabilitation 
facility vocational evaluation. These 
include a work efficiency rating, 
usually obtained through a production 
analysis cm various types of work. 
Situational assessment is included to 
provide information regarding pre- 
vocational skills. Vocational aptitude 
or skills assessment is commonly con- 
ducted through the use of standardized, 
professional work samples and ap':-itude 
tests. 

The purpose of vocational evalua- 
tion in the rehabilitation facility is 
to determine the vocational pjtential 
and independent living skills of handi- 
capped adults. Oftentimes, it is an 
issue of teaching pre-voca .ional and 
vocational skills to individuals who 
have never beon in a work environment, 
thus it is a habilitation rather than a 
rehabilitation environment. Further, 
exposure to jobs and development of 
vocational preferences is included. 

Private practice vocational evalua- 
tion facilities are generally profit 
oriented facilities compared to the 
not-for-profit status of the traditional 
rehabilitation facility. The purpose of 
private practice vocational evaluation 
usually focuses on the handicapped 
individual's potential to return to 
work. Consumers participating in this 
type of program have usually been 
competitively employed and have incurred 
some type of injury. The feasibility of 
returning to pre-injury employment is 
the key issue addressed in these voca- 
tional evaluations. 

Techniques used in private practice 
vocational evaluation center around the 
determination of physical capacities, 
transferability of skills, and aptitude 
assessment. 

As the scope and purpose of the 
rehabilitation facility vocational 



eva]' ation is more comprehensive, the 
J spent in this program usually 
ranges from one to eight weeks. Where- 
as, the more focused nature of the 
private practice vocational evaluation, 
the profit motive, and the consumer's 
situation mandates a more rapid, one to 
five day, vocational evaluation. A 
group process is oftentimes the format 
in a rehabilitation facility vocational 
evaluation program, with up to twelve 
consumers in the process at any point in 
time. The structured nature of private 
p-actice vocational evaluati )n demands 
much more individualized groups. Up to 
three consumers might be assigned to a 
vocational evaluator at a time. 

Credentials vary somewhat for 
individuals in these two settings. 
Rehabilitation facilities that meet the 
standards of the Commission on Accredi- 
tation of Rehabilitation Facilities 
(CARF) usually employ vocational evalua- 
tors that meet the certification of the 
Commission on Certification of Work 
Adjustment and Vocational Evaluation 
Specialists (CCWAVES) . Private practice 
facilities will employ individuals with 
q-^nerally more extensive experience, 
Advanced degrees, and additional 
certifications in axsas such as 
rehabilitation counseling. 

The audience discussion focused on 
the critical communication between the 
vocational evaluator and the referral 
source. Specific referral questions are 
key to focusing and individualizing the 
vocational evaluation in either the 
rehabilitation facility or private 
practice situation. The audience felt 
that one certifying body of standards 
should be acknowledged and required. 
Finally, the semantics between the terms 
vocational evaluation and vocational 
assessment should be minimized in 
reference to the practice of "vocational 
evaluation" in these two situations. In 
other situations, i.e., education 
environments, the difference between 
these terms is meaningful. 

School-Based 

The prac^:ice of vocational educa- 
tion began to appear in schc ^ in the 
late 1960 's. The 1984 Vocational 
Education Amendments, the Carl Perkins 
Act, required that the concept of 
vocational evaluation be implenented in 
education and be made available to all 
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identified handicapped and disadvantaged 
students prior to enrollment into any 
vocational or work-study program. 

In the schc^-based environment, 
the difference between vocational 
evaluation and ideational assessment is 
of importance, ^s noted above, the 
purpose of vocational evaluation is to 
assis': in the individilal's vocational 
development. Whereas, the purpose of 
vo2'^' clonal assessment is to serve as a 
.baslr for planning an individual's 
educa'.ional program. Although the 
process and techniques are similar, the 
purpose is different. In vocational 
evaluation the outcome is to determine 
the consumer's ability to be employed or 
re-employed at various levels ranging 
from a work activity to a competitive 
level. Whereas, the outcome of voca- 
tional assessment is to determine the 
most appropriate vocational training 
program within the parameters of educa- 
tion, A key difference is the avail- 
ability of a structursd work sitc{s) to 
utilize to obtain a work efficiency 
rating{s). 

Techniques utilized in vocational 
assessment focus on the exposure of 
occupations, identification of vocation- 
al interests, identification of 
pre-vocational skills, and aptitude 
assessments. 

The Boope of vocational assessments 
in schools varies considerably from 
state to state. Standardization is 
lacking due to nonspecific federal 
requirements. The scope of vocational 
assessments ranges from vocational 
screening all the way to a full 
comprehensive vocational evaluation. 
The background of the individual 
employed to complete the vocational 
assessment also varies. Again, much 
variance is found among state standards. 
In some states, vocational assessments 
are provided via ft contractual 
arrangement with a local rehabilitation 
facility. in other states, funded 
vocational assessment units have been 
developed in the schools and 
standardized programs are in place and 
reviewed on a regular basis. In still 
other states, inconsistent or 
non-existent programs are identified . 
Le3s than one percent of the individuals 
employed in vocational assessment 
programs are certified vocational 
evaluators through CCWAVES. 

Vocational assessment in schools is 



part of the intervention strategy. 
School -based vocational assessment has 
moved away from the traditional 
rehabilitation model of vocational 
evaluation. Professionals employed in 
school-based vocational assessment 
programs have had to acquire knowledge 
of special education and vocational 
educational program curricula, special 
education services, student and parents 
rights, adult service systems, and the 
world of work in general. The vocation- 
al assessor impowers the student to make 
vocational decisions, understand his/her 
own skills and limitations, and to learn 
how to be a responsible worker* 

The audience discussion culminated 
in the statement that all handicapped 
and disadvantaged students can benefit 
from and should receive a vocational 
assessment. However, not all of these 
students need a comprehensive vocational 
evaluation. 

School Psycholcqy 

There are pragmatic and practical 
reasons for the school psychologist * s 
involvement in vocational endeavors. 
Many definitions of vocational assess- 
ment, such as that proposed by VEWAA, 
actually incorporate a psychological 
component, it is a well accepted notion 
that intelligence test data , acauamic 
achievement test data , personality 
assessment data, and adaptive behavior 
data all have relevance for vocational 
programming. 

Although school psychologists 
perform a variety of roles in the 
schools, a major responsibility is the 
completion of psychoedM'-^ational evalua- 
tions of handicapped st *dents. It is 
via this assessment role that school 
psychologists can assist in the comple- 
tion of school-based vocational assess- 
ments. Much of the data gleaned from a 
traditional psychoeducational evaluation 
has vocational relevance. For example, 
intelligence test data can be used to 
assist in determining the degree to 
which an individual might attain success 
in a given vocational training program, 
and the degree to which certain jobs 
which emanate from training in a given 
program may be realistic vocational 
options for the client. Research 
conducted by Heinlein (1987), has indi- 
cated that the Wechsler Intelligence 
scale is similar to the factor structure 
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of some aptitude tests. This data 
supports such use of intelligence test 
data, and also suggests that, in some 
ways, intelligence test data gleaned by 
school psychologists may be used in the 
same way as traditional aptitude test 
data. Future research of this nature 
may eventually support the substitution 
of aptitude test data with intelligence 
test data, thereby eliminating the need 
for expensive and time consuming apti- 
tude assessment. Since most students 
participating in vocational assessment 
have already been tested with intelli- 
gence tests, such substitution will 
streamline the vocational assessment 
process, and render the process more 
efficient. Because many frequently used 
intelligence tests are superior to 
aptitude tests in regard to psychometric 
and technical characteristics, such 
substitution may alsv*) serve to increase 
the reliability and validity of the 
overall assessment process. At the 
present time it is premature to substi- 
tute aptitude data with intelligence 
test data, and both should continue to 
be considered in vocational assessments. 

In addition to psychoeducational 
skills, consultation and intervention 
skills can be applied by the school 
psychologist to facilitate the vocation- 
al assessment process. Psychologists 
can be requested to consult with voca- 
tional assessors concerning appropriate 
assessment instruments and strategies to 
employ with a particular student, and 
the degree to which intellectual and 
social/emotional difficulties may affect 
a student's training or employability . 

The development and implementation 
of school-based vocational assessment 
programs involve the selections, use, 
and interpretation of vocational tests. 
As Egerman and Gilbert ( 1969) have 
previously suggested, those profession- 
als frequently entrusted with this 
responsibility have had limited training 
in psychology, and are oftentimes 
ill-prepared to deal with the 
psychometric and measurement issues that 
development and implementation of an 
assessment program requires. In con- 
trast, school psychologists are well 
trained in assessment methodology, and 
knowledgeable about psychometric and 
measurement issues . Consequently, 
involvement of the school psychologist 
in the establishment and implementation 
of a vocational assessment program can 



reduce the risk of inappropriaLe selec- 
tion, use, and interpretation of assess- 
ment instuments, and increase the 
overall validity of the vocatical 
assessment process. . ^ 

Audience discussion indicated tnat 
of those individuals involved with 
school-based assessment, the majority do 
have involvement with the school psy- 
chologist. Further, the vocational 
assessment should actually be considered 
a component of the multifactor assess- 
ment. The vocational assessor should be 
a member of the multidisciplinary team. 
The involvement of the school psycholo- 
gist in the vocational assessment 
process can provide the vocational 
assessor with time to work with addi- 
tional students or to expand the scope 
of the assessments. 

The school psychologist's expertise 
in psychometric measurement should be 
utilized by the staff completing the 
school-based vocational assessments . 
However , in rehabilitation facilities 
the on-site availability of the psychol- 
ogist is often lacking . Thus the 
support role is difficult to obtain. 

Occupational Therapy 

The world of work and technology 
has changed. Along with these changes, 
it has become economically feasible for 
the injured worker to be required to 
complete a physical rehabilitation 
program. The technological advancements 
in assessment, work capacity, and work 
hardening programs have enabled the 
profession of occupational therapy to 
offer a valuable service to employers. 
Workman' s compensation and personal 
injury claims create a market for 
medical and vocational rehabilitation 
programs to return these workers to the 
employment site . Rehabilitation is a 
valued and requested entity because 
industry profits are being compromised 
due to the exorbitant cost of long-term 
healthcare programs. 

Occupational therapy functions in a 
dual role in the rehabilitation of the 
injured worker. The occupational 
therapist initially serves as an assess- 
ment specialist in reviewing the work- 
er's physical performance dysfunction. 
It is in this capacity that the profes- 
sions of occupat ional therapy and 
vocational evaluation can become con- 
fused, occupational therapy also serves 
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as an intervention strategy. Function- 
inq in a direct service role, occupa- 
ti\ il therapy moves from an assessment 
technique to a facilitator in the 
rehabilitation process . Therefore , 
occupational therapy can be viewed as a 
developmental process assisting the 
injured worker throughout the rehabili- 
tation and return to work process. 

The assessment component in the 
physical rehabilitation process should 
be completed by an interdisciplinary 
assessment team. Both the occupational 
therapist and the vocational evaluator 
along with various other professionals 
should be members of the assessment 
team. Both professions contribute to 
the interdisciplinary report and recom- 
mendations. Whereas, the occupational 
therapist may continue to work with the 
injured worker, the vocational cvaluator 
does not usually maintain involvement 
throughout the remediation process. 

Along with the increased demand for 
occupational therapy services comes the 
expectation that these services will be 
provided on a time-limited basis. 
Healthcare requirements have mandated 
very specific time frames in which 
occupational therapy services are to be 
provided. The inflexibility of health- 
care regulations act in opposition to 
the individualized service concepts 
which are mandated in the vocational 
rehabilitation policies and practices. 
A blend of philosophical differences is 
needed between physical/vocational 
rehabilitation and public healthcare 
programs and standards. 

The audience discussion focused on 
the inconsistency between the rehabili- 
tation concepts and the healthcare 
regulations. Bridging this gap in 
philosophies is a major step which does 
noed to be addressed- Education of the 
financial agents as to the individual- 
ization of rehabilitation services is 
needed. 

There still exists a need for 
communication and mutual understanding 
regarding the joint roles that the 
occupational therapist and the voca- 
tional evaluator play in the vocitional 
rehabilitation process. Joint publi- 
cations between occupational therapists 
and vocational evaluators to foster 
communication between the two profes- 
sions is needed. Functioning as equally 
contributing members to the 

interdisciplinary assessment team will 



foster mutual understanding of the 
other's role and expertise to oe of- 
fered. 
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Marketing 'he Non-profit Evaluation Service to Private Industry 



Kyle Vohlken C.R.C. , C.V.E, 



Abstract: As the non profit evaluation 
unit begins to broaden its referral base looking 
for new sources of revenue, it should look 
beyond the old reliable (or in some casta i 
unreliable) agencies to private sector industry. 
Reaganomics has necessitated a cutback in public 
sector monief available for services such as 
evaluation or work adjustment jind for the non- 
profit evaluation unit which has traditionally 
depended on these funds, the result can be 
disastrous . Vocational evaluators possess a 
unique knowledge base that the private sactor 
could find very useful, but into which it has 
not .consistently tapped. The probl<»in appears to 
be one of consunication. The non-profit 
evaluation unit must aggressively market thtlr 
services in a style and with language the 
private sector can relate to and understand. By 
dropping the **bleeding heart social workar** 
image and adopting a polished, business-like 
attitude emphasizing the ^^botton line^ in aur 
presentations, local business will be sore 
willing to explore and hopefully utilize our 
services. This paper will present effective 
ways to initially communicate with induatry, 
typical services an evaluation unit can offtr, 
how to present your services, what the pitfalls 
^re and how to avoid them, and report writing 
for industry 



The broad knowledge base of a Vocational 
Evaluator is oftentimes not appreciated, 
sometimes not even by the evaluator. If as 
evaluators, we arc working with the same 
population month after month, we may get into a 
tut and think "anybody can do this, it's Juot 
common sense!" At these times it's important to 
step back and take a look at the skills 
possessed by mosr evaluators. Once these skills 
have been defined and outlined i\. will be easier 
to see how they can apply to needs outside the 
traditional referral sources, specifically 
private business and industry. 

The moat obvious skiil possessed by all 
^valuators is knowledge of tests and measures 
and how to most appropriately and ethically 
apply them . Evaluators have knowledge of 
validity, standardization, and resources for 
testa and measures. Also most evaluation units 
contain a wide variety of worksamples purchased 
with the profile of the local labor market in 
mind. Hopefully an evaluation unit would not, 
for example, purchase a workaample simulating 
industriaa. sewing if that Job did not exist 
locally. 

Most evaluators have also been trained in 
Job and task analysis and are able to relate the 
information gained from the analysis to worker 
trait groups and other critical information 
gained from worksample testing. This way 
evaluators have a unique and effective way to 
a^tch workers to Jobs with a great potential for 
success. 

Also, depending on a particular evaluator *s 
work situation, knowledge of local labor 
resources and training resources may be part of 
the knowledge base. 

Now, what are the types of issues important 
to industry. Probably first would be the famous 
"bottom line". Most businesses operate with a 
profit margin that they would like to keep 
rather wide. Ways to insure this are to hire 
skilled workers, decrease training time and 
decrease turnover. 

One of the most efficient methods of 
decreasing training : ime and turnover, and 
hiring workers possessing the needed skills is 
to fit worker's skills to available jobs, or to 
select appropriate training programs to match 
employees to available jobs, 

Is this starting to sound familiar? 
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There are a myriad of ways in which an 
evaluation unit can assist private industry. At 
a very basic level, we can provide objective, 
measurable data to use as one part of the 
screening process. This can be done through 
psychometric or aptitude testing. We can also 
provide job analysis to identify the worker 
skills needed to successfully perform certain 
tasks. By observing the process used to 
complete a task, or by doing a formal job 
analysis we can provide information to the 
employer that he simply may not have the time to 
gather himself. Instead of trying workers "hit 
or miss** at particular workstations, we can help 
insure a successful placement by identifying 
worker traits necessary for success. 

Vocational cvaluators are also uniquely 
skilled for providing information to help 
integrate injured workers back into the 
workplsce. Through our background and training 
in characteristics of disability groups as well 
as j ob analysis we can provide information 
regawllng job and workstation modification and 
work environment accessibility. We can also 
provide a way to identify the injured worker's 
skills and make suggestions for retraining 
and/or alternative work with the same employer. 

Finally, during manpower layoffs evaluation 
units can be of service to industry by 
identifying skills transferable to other jobs or 
occupational areas, perform Interest and 
aptitude testing which can be used in a 
vocational counseling situation, help with 
resume development, and make recommendations, 
regarding training and placement. 

Now that we've idertlfied some ways in 
which our services can be of use to industry, we 
need to figure out a way to let Industry know we 

exist. ^ 

One of the best ways is personal contact. 
If you know someone who works in a supervisory 
or management position, talk to them about what 
you do and how that could help industry. If you 
know someone who works iti Personnel or Human 
Resources, they may be the ones who make the 
decision to utilise your services. 

Brochures worK well too. However we must 
guard against the •♦bleeding heart social worker** 
image that private industry seems to have of 
rehabilitation professionals by speaking the 
language of business. Brochures or publications 
should be designed to specifically target 
Industry and not be leftover brochures from a 
rehabilitation conference. Issues to address 
clearly and concisely are; Cost reduction, 
decreasing employee turnover, identification of 
work skills in a timely, cost effective manner, 
and getting the injured worker back on the job. 

If your nrea or corojnunity has a Personnel 
Directors Association they may hold monthly 
meetings, and they may have a short program at 
these meetings. Contact the program committee 
and see if you can ma^e a presentation at an 
upcoming meeting. This way you would greatly 
increase your exposure to the Individuals within 
organizations who may make the decision to 
request your services. 



Short in-services for Human Resource 
Departments are also helpful. If the business 
or industry is large erough, their personnel 
people may be in a Human Resource Department 
which will also house staff working with injured 
workers, substance abusers and other employees 
requiring services. The best type of in-servlce 
to give would probably be no more than thirty 
minutes in length and concisely cover the unique 
services you could provide. It would also be 
appropriate at this time to discuss your 
credentials and experience. Be prepared to 
answer questions regarding fees and timeliness 
of services. Remember, individuals in business 
and industry are accustomed to efficiency and 
respect it. Having answers at your fingertips 
will be much more Impressive than the ♦♦I'll get 
back to you on that^^ kind of answer. 

One final item to remember is flexibility. 
Business and Industry are not interested in a 
♦♦canned** evaluation program, and they certainly 
are not Interested in a week long vocational 
evaluation for their employees . They want 
precise, relevant Information, and they want It 
as soon as possible. A program or service 
designed specifically to meet their needs and a 
fee schedule based on these specific services 
with a rationale to support It will be greetly 
aijprecJated by the Industry you're dealing with. 

Now that your services have been requested, 
what happens? Don't be surprised when the phone 
call comes ' and the business or Industry 
requesting services would like them within the 
next forty-eight hours. Or, you give them a 
proposal for services along with a fee schedule 
and they don't call you for six months. This is 
not uncommon because you are, • in that case, 
probably a small part of a larger program and 
the Initial contact was for information 
gathering, If your facility Is serious about 
cultivating private luslness or Industry as a 
referral source, you must try your best to 
provide services within their time frames, even 
If that means a little reshuffling on your 
part. 

Once you agree to provide services, you 
control the situation and your professional 
Integrity Is on the line. Have the conlxdence 
to retain perfjonal and professional ethics i 
especially as It applies to testing Individuals. 
If aptitude testing Is requested. It Is your 
responsibility to ask for a job description of 
the position being tested for, and to Interview 
someone who Is currently In that position and 
perhaps the Indlvlcaal who supervises that 
position. Do not, for exanple. give a 
mechanical aptitude test because that's what the 
business requests. Find out how they are going 
to use the information, and make sure you 
control the process of tool selection. It is 
also Important to obtain a copy of the Federal 
Register's Uniform Guidelines on Employee 
Selection Procedures. Read It and make sure 
your actions are within the Guidelines. It Is 
'Jso Important for you to request that your 
services are used as only one part of the 
screening process. 
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it your ser^/ices are specifically requested 
for aptitude testing and you decide to take the 
job, there are a few things to remember and to 
..u*"5f 5° discuss with the business or industry 
with which you will be worl'iing, 

Is there an appropriate testing 
environment? Most companies prefer testing on 
cneir site as U reduces employee "downtime" 
taken up with travel. This is acceptable so 
■i-ong as the testing environment is appropriately 
well lighted and without distractions. if no 
acceptable site is available suggest your own 

Are the employees sufficiently prepared for 
testing? It is important that shift workers, 
for example, have not just completed eight hours 
of work when they walk into a testing situation. 
It Is also important to explain the purpose of 
the testing, how the information will be used, 
and • the fact that it is only one part of the 
screening process. Also insure that reading 
levels are adequate for the types of measures 
you are administrating. 

Don't be afraid to decline an offer if you 
feel there is a conflict with ethics or if you 
feel you can't provide an adequate service, It 
i* very important that "fairness" to potential 
f mdidates be maintained, and that you are 
satisfied the information will be handled 
appropriately, 

Whether you have been contracted for 
testing, consultation, job analysis, or work 
station modification, the final report ycu send 
is very important. it will be handled as a 
docuaent having authority and oust be written in 
a straight forward, business like manner with a 
minimum of rehabilitation jargon » Any rehab 
terms used must be clearly defined or your hard 
work will be useless to the businesar or 
industry. 

At the very minimum your report should 
include 



testing was the requested 
service, include any special circum- 
stances that could have affected 
outcome, Also attach an appendix 
describing each test and measure used 
and norm group information. 

s pecial equipment was recom- 
ended, give name and ad^i ress of source 
and approximate price if available. 

Be careful to remain "neutral" re- 
arding any individual employee. Do not 
recommend any employee tested for a 
particular position, and be sure from 
the onset of a relationship with 
business that this is clear. 

In this age of diminishing public monies, 
it is becoming increasingly important to broaden 
the referral base of the non-profit evaluation 
unit. Private industry is one area to look at 
when considering the nontraditional referral 
source, Because the private* sector is so 
different from the agencies that evaluation 
units ar** accustomed to dealing with, it takes 
planning and commitment, as well as a specific 
marketing strategy, to make it work. Evaluators 
will need to gain flexibility in how they view 
their skills and what they may have to offer to 
business and industry, Evaluators may also find 
they enjoy the challenge of a new type of 
.service, and ultimately enjoy their job more. 



Referral source, 'client name, place 
and date of testing (if that was the 
service provided). This information 
should stand out at the top of the 
report for easy access. 

Description of purpose of referral , 
If testing was done, include a brief 
description of the position for which 
the tes*:^nB was given, names of tests 
and measures used, worker traits being 
measured and rationale for choosing 
those particular tools. If workstation 
modification wa ? requfisted, be very 
specific as to machines used, 
measurements taken and accessibi.Uty , 

Outcome of serv ice - include test 
results using the terms below average, 
average, above average; include recom- 
mendations for workstation modification, 
sources for specialized equipment, and 
other recommendations based on an 
individual employee's needs, 
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This paper briefly explains some of the differ- Two Sldts tn th^ icc... 

cnccs between community-based employment advocates 

c\^lTon°?nHcc JrTn" °'h'1" T the last four years I have been systcma.i- 

J rmod^fn; f ' .^"V^cn present cally reviewing the literature in transitional and sup- 

a general model for the use of vocational evaluation ported employment. During that time I searched the 

w..h.n communay-based employment. literature for articles dealinVwith :oclt"nal assess- 

mcnt and evaluation within community-based employ- 
ment. I eoneluded that eommunity-bascd employment 
advoeates have a limited knowledge of vocational 
evaluation and have eondemned us for performing the 
role assigned us in the VR system. These attacks have 
made their criticisms hard for us to discuss in a 
rational manner. However, if we look beyond emo- 
tions, wc must also accept that some of their criti- 
cisms of vocational evaluation are valid. 

Communitv-ntiscd Emnlnv mcnt Looks nr A< f«yiy^<f. 
mfijli - The first issue centers on eligibility for ser- 
vices. Because vocational rehabilitation services are 
not entitlement programs, a determination of eligibility 
must be made shortly after a person seeks help from 
VR. In some states, vocational evaluation services help 
determine if the new client could benefit from reha- 
bilitation services. If the person was severely disabled, 
he/she would not be considered a good bet for VR 
services (Menehctti & Rusch. 1988). Because the 
emphasis in community-based employment is serving 
persons with severe disabilities, advocates decided that 
this "screcning-our process was ''bad" and. therefore, 
so was vocational evaluation. 

The second criticism is that vocational evaluation 
and. especially, assessment are linked to the mental 
testing approach. As we know, this is the approach 
begun with Benet about the turn of the century, 
evolved through military and civilian selection proce- 
durcs. and now is used as the basis for most educa- 
tional and employment testing. This type of testing is 
based on the trait-and-factor approach at d attempts to 
Identify general factors that predict empl.yymenl in 
various jobs. In a recent chapter. Mcnehetti and 
Rusch (1988). two of the leading authorities in com- 
munity-based employment, cite two major problems with 
the mental testing approach. First, many of the tests 
used in selection have fairly low correlations between 
test and criterion. This is especially true of general 
aptitudes and abilities, such as those measured by the 
General Aptitude Test Battery. Second, testing is 
criticized for being predictive in nature. 

The linking of vocational evaluation with the 
mental testing movement is only partially true, Al- 
though evaluators use tests and other standardized 
assessment devices, vocational evaluation, with its 
emphasis on situational assessment and job siic cvjiluii^ 
tion. was born in the late I950's because tests were 
not accurately measuring the skills and abilities of 
persons with disabilities. With regard to prediction, 
the goal of selection is to locate a person who will 
perform well on the job. In doin^j so. wc are predict^ 
ing future success based on present performance. The 
providing of all rehabilitation services arc based on 
calculated risks and subjective probabilities; vocational 
evaluation services merely attempt to obtain objective 
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information that can be used to predict future out- 
comes. 

Community-based employment centers on the 
place-train model where a person is first placed on a 
job and then trained to do that job by a staff person 
(Hill, 1986; Moon et al., 1985). The beauty of this 
model is that it avoids many of the problems created 
by first training a person and then placing him/her 
either in sheltered or competitive employment, with 
little or no follow-up services. For example, because 
training takes place on the job site, it reduces the 
need of having to generalize from one environment to 
another (Rusch & MithauR, 1985). It also ends or 
reduces social isolation and provides many realistic 
emrWiiient opportunities. If community-based emp'oy- 
meat is pushed to its logical conclusion, a separate 
pre-placcment assessment is not needed. The worker is 
placed on the job and trained. If he/she can perform 
well, what other criteria is required? 

The final implication is that tests, work samples, 
etc. have not been very successful in predicting job 
success for many person with disabilities. 

v^gati ft""' Evaluat jf^n Lonk^ at rommunitV-Bagcd 
KmnlQvment - As an evaluator, I admit to reading the 
transitional and supported employment literature with a 
bias. There are, however, some very basic concern.^ 
about the use of the place-train model that need to te 
addressed. First, unless assignment of a particular joo 
is made randomly, there must be some type of decision 
making. In other words, some professional(s) must 
decide who is placed and where this person is placed. 
As with any selection decision, some persons are 
chosen and others are not. As long as there arc more 
persons needing services than there are competitive 
labor market jobs, choices will have to be made 
Although some of the earlier literature indicated pre- 
placemcnt selection (e.g.» Mlthaug A Haring, 1977; 
Wchman, 1981), the literature in the mid-1980s has 
almost totally neglected this issue. However, three 
very recent works in this area have included dis- 
eussions of evaluation as part of the place-train model 
(i.e., Bellamy et al., 1988; Gardner et al., 1988; and 
Mcnchetti A Rusch, 1988). The issues are not to 
evaluate or not evaluate; they are when and how to 
evaluate and who shouU perform the evaluation 
(CCWAVES, 1989). 

The above concern leads to the second impression: 
eommunity-based employment has not been honest in 
dealing with evaluation issues. A close review of the 
literature gives the impression that assessment, or at 
least some decision making process, is used in most 
eommunity-based employment programs. However, it is 
not emphasized. Most likely, assessment was not 
emphasized because it is logically inconsistent with the 
stated purpose of community-based employment - to 
provide competitive employment for persons with severe 
disabilities. In other words, if some choices must be 
made, would not the most disabled persons be left out? 
- the'vcry target of the community-based employment 
movement. 

Third, by focusing their criticism on the mental 
testing approach, community-based employment ad- 
vocates have overlooked alternative evaluation methods 
such as situational assessment (Dunn, 1973; Genskow, 
1973), job site evaluation (Botterbusch, 1978), and the 
emphasis on close behavioral observations (Halpcrn ct 
al., 1982; Coker et al., 1983; Botterbusch, 1985). 
Although these practices have been to some degree 
rep: iced by an emphasis on short-term evaluation that 
relics on tests and work samples (Botterbusch, 1983), 



these other techniques still exist and are viable tools. 
It is interesting to note that the many of the evalua- 
tion methods 5n Bellamy et al. (1988), Gardner et al. 
(1988), and Mcnchetti and Rusch (1988) have existed in 
vocational evaluation for almost 30 years (Neff, 1966). 

Finally, the present social, political, and funding 
environment surrounding community-based employment 
has produced much heated debate with resentment and 
misunderstanding on both sides of the issue. The 
success and cost effectiveness of community-based 
employment is a research issue; it should not be an 
emotional issue. If eommunity-based employment is to 
be implemented on a basis of other than cost-effec- 
tiveness, then it should be a clearly stated policy that 
human dignity and access to the community are more 
important thari the cost of services. 

T^y n ]Plfft ft''< Approay tTtif tft VftCP*^"" EvBluation 

Part of the confusion about the role of evaluation 
and its methods derives from the observation that 
evaluation deals with assessment from two different 
points of view. The criticisms of vocational evaluation 
discussed in Mcnchetti and Rusch (1988) have clearly 
and correctly raised this issue. There are two major 
models in evaluation: (1) psychometric and (2) clinical 
(Cobb, 1972). The psychometric model was taken from 
military and personnel psychology; it requires the 
careful and conuistent use of standardized devices to 
measure traits (e.g., aptitudes, academic levels, tcm- 
peraments). These traits are then validated against job 
requirements. Most of the tests, assessment systems, 
and work samples (Botterbusch, 1986; 1987) presently 
available are based on this approach. Because of 
improvcv isscssment technology, a reduction in the 
amount of funds and, therefore, the time provided for 
vocational evaluation services, the influences of private 
rehabilitation, and the emphasis on direct placement, 
the psychometric model is the more commonly used at 

present. ... , 

The clinical model emphasizes the intuitive skills 
of the evaluator where he/she observes the client 
under real work or in work-like situations. This type 
of evaluation is best performed in the community. The 
focus of the evaluation is to determine hoy* the client 
interacts with others, what methods of training arc 
more effective, preference for specific activities, and 
related issues. The major tools are the careful use of 
behavioral observation, behavior analysis techniques, a 
knowledge of the client as a person, and knowledge of 
how he/she reacts in specific situations and under 
certain conditions (Messmer, 1983). The outcome of 
this method is a carefully devr'oped understanding of 
the client; an understanding that can be used to ensure 
that services are provided effectively. Although these 
two separate approaches are often viewed as being in 
opposition, one can and often should be used to rein- 
force and support the other. 

ipft yk to the Basics 

In community-based employment, professional 
rehabilitation service workers should have two separate 
goals. The first is to decide who has a reasonable 
ehanee of succeeding in competitive employment and 
who will not. As long as not everyone can be served, 
this decision has to be made. The second goal is to 
determine the needs of the client so that optimum 
strategies for employment, training, and follow-up 
services can be provided. This means knowing the 
client as a unique individual. 
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These goals must oc linked to mefhods. Voea- 
tional evaluation started with the elinieal model nnd 
gradually moved toward the general use of a psycho- 
metric model. In dealing wiih persons with severe 
disabilities in eommunily-based employment, it appears 
that the elinieal model may be the more effeelive of 
the two. Limited support for this eonelusion eomes 
largely from ihe follow-up studies done by Projeet 
Eniployability at the Research and Training Center of 
\ irginia Commonwealth University (Koehany & Keller. 
I98J; Wehman ct al., 1982; Wchman & Hill. 1985; and 
Hill, J986). A careful review of this projeet led to the 
eonelusion that most failures in this supported employ- 
ment projeet could be ' ttributed to: (i) worker at- 
titudes toward work. (2) skill training problems, and 
(3) maladaptive behaviors. These findings agree with 
the commonly accepted truism that most employees fail 
because of problems in work Imbits^or interpersonal 
skills, and not from skill deficiencies. Such problems 
need to be identified during evaluation and prior to 
placement. 

The clinical approach requires that evaluators be 
capable of carefully identifying and describing be- 
haviors. It also requires that information obtained 
through observation and behavior analysis be used to 
conslrucl a valid picture of Ihe cnlirc client. If the 
criticisms of current evaluation practices by com- 
munity-based employment advocates are accepted, then 
the person must be seen as more than a worker trait 
profile. This leads to a holistic approach that has 
parallels in medicine and psychotherapy. As a personal 
note* r believe that evaluation must deal with the 
whole person, including his/her family, values, physical 
environment, and social environment. The commonly 
held idea that a person have a Vork personality" is 
simply incorrect. A person must be viewed as more 
than the sum of his/her attributes. 

Evaluation emphasizing a holistic approach needs 
to begin with a full understanding of the person and 
move from there to an understanding of the person's 
social and physical environment. It should also help 
the client learn more about him/herself« Because most 
severely disabled persons lack realistic knowledge of 
the type of jobs existing within the local labor market, 
any evaluation program must include considerable 
vocational exploration and career decision making. 
Perhaps the cluster approach suggested by Bellamy et 
al. (198R) would prove useful. Because community- 
based employment centers jn teaching the new worker 
vocaticnal and social skills, another task for evalua- 
tion is to determine how and under what conditions 
the worker learns best. Turning to more traditional 
concerns of evaluators. assessment should include 
estimates of proficiency, work rate, work quality, 
perseveration, and endurance (Wchman, 1981). Under 
this holistic approach, independent living /;ills would 
also be an integral part of assessment. Assessment of 
transportation and mobility, communication, self-care 
and appearance, socialization, functional reading and 
computation skills have also been suggested (Wchman. 
1981). In adfiition. evaluation would include assessment 
of parents/guardians and other potential sources of 
support. 

In holistic evaluation, the emphasis would move 
from work samples and tests to job site evaluation and 
siti<')tional assessment. Data collection would be based 
largely on systematic behavior observations and on 
objective data collected during production. The three 
general approaches to behavior assessment suggested by 
Close et al. (1985) are suggested: (1) direct assessment 
of criterion behaviors in either a real or simulated 



setting. (2) measurement of the knowledge of these 
behavior*^, and (3) evaluation of how persons learn new 
competencies. Although this approach is admittedly 
elinieal. information gathering is not limited or hap- 
hazard. Just as pointiest artists use many dots of pure 
color to form a picture, the evaluator must collect 
accurate and detailed data before it can be combined 
Into a complete picture of the client. 

Both the information sought and the techniques 
employed must be solidly grounded in the reality of 
local labor markets. Evaluators must know what jobs 
are available, where they arc available, and what their 
requirements are. Community job surveys and the use 
of detailed job and task analysis wouIq be major tools. 
Job analysis methods must go beyond the commonly 
used U.S. Department of Labor (1982) method and 
include enough information on each task in the posi- 
tion to permit simulation and analysis. After the 
client is placed, task analysis would continue to be 
used to develop training procedures. In addition to 
skills, the social environmeni:, and physical context of 
the job must be known and included in evaluation. 
Rusch's (Rusch & Mithaug, 1980; Schutz & Rusch, 1982) 
social validation process could be used to determine 
the real expectations of new workers in a variety of 
settings. These expectations would be included ns part 
of the evaluation process. As differences between the 
client's present behavior and required behaviors are 
identified, specific treatment plans could be developed 
to overcome these deficiencies. 

A Model for Vocationa l Evaluaflon In Communftv-B«.sed 
Rmnlovmcnt 

This holistic vocational evaluation model is com- 
patible with community-based employment. This model 
is seen as being applicable for use with severely dis- 
abled persons, especially those with mental retardation. 
It is not intended to be used as a general model for 
providing evaluation services. 

The Generfll Mftdcl - Figure 1 presents an over- 
view of the vocational rehabilitation process as seen by 
an evaluator. Persons are referred to community-based 
employment programs either as new referrals or from 
other programs (such as sheltered employment). With 
new clients the first step is to determine if they are 
tligible for service and, if so, what program will suit 
their needs. As in the present system, a small number 
of responses would be referred for evaluation to deter- 
mine eligibility for services. Vocational evaluation 
would begin after the referral to a community-based 
employment program. 

The most common outcome would be continuing 
within a community-based employment program. Speci- 
fic, individual recommendations would be made for the 
type of program (e.g., individual, cnclnvc. mobile crew), 
the type of job (e.g.. manufacturing, grounds, food 
service), and the amount and type of support needed. 
The last recommendation is used to plan training, other 
services, and ongoing support. Infrequent recommenda- 
tions would include referral to prc-placcmcnt training 
in specifically defined areas (e.g., specific vocational 
skill training, mobility training), a decision that com- 
munity-basco employment is not needed, a decision that 
other VR programs arc most appropriate, and a deci- 
sion that the client could not benefit from services. 
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The next step is placement into a eompetiiive 
employment situation that meets the OSERS (Federal 
Register^ 1984) definitions of suppor'jd employment. 
After placement training would be^^m; many of the 
methods and techniques used to train the new worker 
would be derived from the evaluation report. Training 
would continue until the new worker reaches the 
required levels of proficiency. At that point the 
trainer would begin to fade from the job site, turning 
direct supervision and training to the supervisor or co- 
workers. The final step in the model deals with the 
provision of follow-up services. In transitional pro- 
grams follow-up would gradually end; in supported 
employment these services would continue indefinitely. 
An important component of this process is collecting 



program evaluation data luring placement, training, 
fading, and follow-up. This information would be fed 
back into the vocational evaluation program to improve 
services. 

The final section of this paper will expand the 
voeational evaluation portion of this general model. 

The Holistic Vocational Evaluation ProCv^S. • The 
evaluation process bcp.ins with intake. Existing case 
records are reviewed and additional information is 
obtained, if needed. Evaluation staff meet i nd inter- 
view the client, VR counselor, parents, gufirdians, 
ai.d/or advocate. Preliminary assessments of parents/- 
guardian's encouragement ari support for competitive 
employment are obtained. During the process the 
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needs and eoneerns of the clicni and others arc ob- 
tained. Next the cvalualor and the client jointly 
fyVflp) ^" ^"^'^'^"^^'zed vocational evaluation plan 

I'hc types and mcMiods of assessment to be used 
lor evaluating the client are set forth in the evalua- 
tion plan. Assessment would include personal and 
social skills, occupational exploration, learning, in- 
dependent living skills, environmental analysis, and 
training. Occupational exploration should be largely 
hands-on in the community and in many eases can be 
combined with job site assessment. Independent living 
skills assessment can take place within the evaluation 
unit or be performed by a specialist in this area. 
Training assessm;nt attempts to determine the client's 
training needs for a specific occupation. Although 
training on the job after placennent will remain the 
c.iiphasis, in some situations, limited skill training may 
be needed prior to placement. Environmental assess- 
ment estimates the degree and type of support avail- 
able within client's family, group home, community, 
etc. Weaknesses in these support systems arc identi-' 
fied so that they ean be addressed prior to or during 
training. Environmental assessment is seen as a first 
step in building a support network around the client; 
this network should be maintained throughout eom- ' 
munity-based employment. Some programs will include 
situational assessment as another method. The amount 
of time needed to complete this evaluation period will 
depend on the needs of the client; it is expected that 
this process will require several weeks. 

These types of assessments would use the follow- 
ing nriethods: behavior observation, behavior analy^.is, 
job site evaluation, situational assessment, and occup'a- 
tional information. 

As seen by the dotted line around the type of 
assessments, all processes arc based on the evaluator's 
knowledge of the local labor market, job and task 
analyses, social validation information, and program 
evaluation results. Although knowledge of the local 
labor market is essential regardless of what evaluation 
methods are used, it is particularly critical in com- 
munity-based employment programs. T'le cvaluator 
must be able to spend considerable tin^c in the com- 
munity so a realistic knowledge of job opportunities 
and demands can be developed. 

When all information has been obtained, the 
cvaluator is able to develop a complete picture of the 
client. A staffing would occur after both cvaluator 
and client know tlie client*s needs and aspirations. 
This meeting woi ! present the preliminary results of 
the evaluation and would emphasize the client's pro- 
gram and support needs, job interests, and goals. The 
staffing would be attended by the cvaluator, client 
referral source, parcnts/guardian/advocates, and other 
persons important in the life of the client (Wheeler, 
1987; Fadcly, 1988). In addition to providing input on 
career options, these persons would also act as a 
support network for the client. During the staffing, 
clarifications of the informat'jn collected during evalu- 
ation would be made and plans developed. The major 
outcome would be detailed information on training 
techniques, interests, and level of support needed. 
After the staffing, this information would be sum- 
marized into an evaluation report. These results would 
be used to plan future services. 

The evaluation report would contain the staffing 
recommendations, represented by the diamond decision 
symbol in Figure 2. The most common outcome would 
be placement in a community-based employment pro- 
gram. 11 is expected, however, that other outcomes 



will exist for small numbers of clients. Two of the 
more common would be specific prc-placcmcni skill 
training gnd referral to another program. Afttr com- 
pleting prc-placcmcnt training, the client would enter n 
community-based employment program. In rar; cases 
services would be terminated at this point. 

The community-based employment services of 
placement, training, fading, and follow-up would then 
occur. As diagrammed in Figure J, program evaluation 
data would be collected to provide feedback to tiie 
evaluation unit. 

Ramifications of the Model - The use of this 
vocational evaluation model within community-based 
employment has numerous ramifications for evaluation 
staff, the host organization, and services. Some of 
these are briefly outlined as follows: 

1. Qualifications of the Evaluator - This system 
of vocational evaluation will require highly 
trained staff who are capable of careful 
analysis and who have the ability to integrate 
a large number of variables to form a com- 
posite picture of the client. This clinical 
approach requires training in behavioral 
observation and behavior analysis. For cvalu- 
ators presently using primarily tests, work 
samples, job matching programs, and other 
techniques based on the worker trait profile, 
this represents a total change in philosophy. 
The emphasis on the local labor market means 
that evaluators will have to be trained in job 
and task analysis, including identifying sig- 
nificant factors in the social environment. 
Some of these competencies should already 
exist in evaluators certified by the Commis 
sion on Certification of Work Adjustment and 
Vocational Evaluation Specialists (1989). 

2. Community Interaction - The holistic model is 
much more interactive than are many tradi- 
tional evaluation programs. The evnluator 
must be able to move around the community 
to obtain current job information, perform job 
site evaluations, and provide for occupational 
exploration. 

3. Cooperation with Other Staff - Because this 
model emphasizes the use of vocational evalu- 
ation to provide information needed to im- 
prove job placement and training, cooperation 
with other staff is required. 

4. Networking - The cvaluator must be able to 
communicate with a wide range of persons 
having an interest in the client. Parents, 
group home staff, independent living staff, 
job coaches, and employers arc common 
examples. 

5. Program Evaluation - The rational collection 
of program evaluation data arc essential for 
improving the system. This need for data 
complements the increased need for interac- 
tion with other professionals and the com- 
munity. 

6. Time and Money - Holistic evaluation will 
have higher personnel costs per client than 
assessment based on a psychometric model. 
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Time is needed for behavior observation, 
hands-on experiences, and getting to know 
the elicnl as a unique person. Evaluation 
time will have to increase well beyond the 
Ihree days commonly allowed at present. Of 
course, the time spent in evaluation must be 
dependent on the needs of tnc client. This 
increased staff time per client translates 
directly into a higher cost per evaluation. 
This will be a major barrier against its use. 
However, if the evaluation period leads to 
better program selection, shortened training 
times, and more realistic placements, these 
increased costs may be jus;ified. 

Conclusloiy 

This paper presented the initial" conceptualization 
of a new model for assessing persons prior to place- 
ment in community-based employment programs. It 
incorporates a holistic approach that depends largely 
on careful behavior observation, performance standards 
within the community, behavior analysis, and the active 
involvement of the client. 
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Abstract: 

Much confusion and controversy has accom- 
panied the establishment of supported employment 
Into habilitative nnd rehabilitative settings. 
Likewise, concern and frustration has highlighted 
the integration of appropriate vocational assess- 
ment within supported employment. This compen- 
dium of artJ.cles addresses both Issues. The 
authors take the approach that we should be and 
are moving toward consensus regarding vocational 
assessment and supported employment. They blame 
no one and encourage collaboration among profes- 
sionals to move toward consensus in facilitating 
succcessful employment for people with severe 
disabilities. 



Introd^lc^^op 
Pamela J. Leconte 

» confounding problems re- 

hnbilitation personnel, particularly vocational 
eyaluators, are faced with today regards voca- 
tional assessment and supported employment. 
There has been much confusion and controversy 
surrounding the function vocational assessment 
serves in supported employment. This confusion 
naturaUy leads to questions concerning what role 
vocational evaluators play in the supported 
employment process. Since the infusion of sup- 
ported employment is spreading to more and more 
habilitation and rehabilitation programs, the 
issues about function and role of appropriate and 
effective vocational assessment have become 
national concerns. 

Confusion and controversy typically gener- 
ate anxiety and frustration. Vocational evalua- 
tors across the country have expressed such 
reactions to the supported employment movement. 
Further, as supported employment begins to "take 
shape" as a real process for individuals with 
disabilities, and as outcomes of the process are 
realized, supported employment personnel have had 
to struggle with vocational assessment issues. 

To'j confusion about the relationship bet- 
ween vocational assessment and supported employ- 
ment has been polarized by two notions. One 
notion, espoused by leaders of the supported 
employment initiative, involved the perception 
that supported employment often was the only 
appropriate intervention for some individuals 
with severe disabilities. Carried by the momen- 
tum of a new technology and by the fervor which 
often accompanies new Ideas, many professionals 
began to accept or assume the belief that sup- 
ported employment supplanted other types of 
rehabilitation services. One service that they 
advocated the need to supplant was vocational 
assessment. This was due, in part, to a major 
misunderstanding or raisperception about the 
numerous differences between the terms and ser- 
vices labeled vocational assessment and voca- 
tional evaluation. Experience and literature 
bear out the premise that many of these advocates 
identified all vocational as:;^^ -ment or appraisal 
services as comprehensive vocational evaluation 
including a strong association with standardized 
tests and commercial systems. 

At the othei end of the polarized spectrum 
many people within rehabilitation, including many 
vocational evaluators, seemed unawam that the 
services some evaluators had been providing 
represented a disservice. Therefore, they took 
umbrage with the ide.i that vocational assessment 
and vocational eviO.uation services should bo 
supplanted, or, in other words, eliminated 
Regardless of the reasons why some vocational 
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evaluators and other rehabilitation personnel 
made negative, barrier-setting judgements about 
some individuals with severe disabilities, it 
remains that such decisions are discriminatory 
and unacceptable. Facts demonstrate that some 
rehabilitation personnel were not accommodating 
people with severe, more difficult to serve dis- 
abilities by employing different, creative as- 
sessment techniques and strategies. In many 
instances, vocational evaluation reports con- 
tinued (and, unfortunately, still do) to "screen 
out" thtse individuals from future services or 
employment by making the determination that these 
people were "not employable". 

Fortunately, pendulums swing long enough 
that they begin to hover around the center- - 
between two poles. Also, some of the initial 
emotions by professionals on both sides are being 
replaced with a focused concern for how to pro- 
vide maximum success for individuals being served 
by supported employment, Thus, we are moving 
toward consensus. To do that, each group of 
professionals must attempt to understand the 
contexts and technology associated with effective 
supported employment and appropriate vocational 
assessment. An underlying assumption to this 
Joint investigation-- searching for successful 
methods --is t'\at vocational assessment should 
play a large role in the provision of supported 
employment services. In other words, there are 
several uses for assessment in this service 
option. Indoed, incorporating vocational assess- 
ment la essential to successful and satisfactory 
outcomes for th<> individuals participating In 
supported employment. 

The purpose of presenting this session at 
the Issues Forum was to move closer toward con- 
sensus. It was intended that by providing the 
opportunity for professionals from supported 
employment and community-based backgrounds to 
discuss Issues with professionals with vocational 
assessment expertise, the circle of consensus 
would grow. It was also intended that par- 
ticipants in the session could freely interact 
with speakers who have already tackled the prob- 
lems of integrating vocational assessment into 
supported employment programming and who had 
developed some effective methods. 

The following papers are summaries of those 
presented at the Fourth National Issues Forum. 
It is exciting to have the opportunity to learn 
from professional experts who are ^.nowledgeable 
about and believe in both the efficacy and value 
of vocational assessment in supported employment. 
The backgrounds of all three experts incorporate 
practitioner and researcher viewpoints. Also, 
each of the experts possesses a solid foundation 
in vocational assessment and supported or com- 
munity-based employment practices. 

The first paper s(*ts the stage for the rolo 
vocational evaluators can and must play in sup- 



ported employment. Inherent in Ayella's ad- 
monishment and challenge to us is the belief that 
vocational assessment can be useful and is essen- 
tial to successful habilitation and rehabilita- 
tion oZ individuals with severe disabilities. 
Also, inherent in the paper is the idea that 
vocational evaluators must assume a leadership 
role in the meshing of assessment and supported 
employment or our field may be radically Impacted 
in ways that we will not find satisfactory. 

The paper by Hagner discusses the histori- 
cal precedents on which supported emp'.oyment is 
based and how vocational assessment plays a 
pivotal role in this process of rehabilitation. 
It should be noted that the author refers to 
vocational assessment as vocational evaluation, 
though readers should interpret this term to mean 
the broader vocational assessment service design 
in this case. Hagner outlines the various stages 
of assessment and emphasizes the questions which 
should be asked to guide the vocational assess- 
ment and employment processes. 

In the final paper by Sasnett, she des- 
cribes an example of a successful process of 
vocational assessment for supported employment, 
This process has been implemented and refined 
over the past t to years, and demonstrates how 
vocational assessment and supported employment 
purposes and processes fit "hand in hand". 

It is hoped that readers of these papers 
will either improve their understanding of the 
positive and recursive relationship between 
supported employment and vocational assessment or 
that their confidence will be heightened in what 
they are attempting. As a result, even more 
individuals with severe diaabilities should 
experience the satisfaction and success in em- 
ployment for which we strive. 

rj^^ p^]^ Vnr^t\nnAX EvaluatOTS in Suppprted 
tr^p^n ynipnt! Vlcr nrci Not Victims 

Karen Pell Ayella 

We are entering the second generation of 
supported employment. By that I mean that we are 
moving beyond the research and demonstration 
projects which were begun approximately ten years 
ago and are moving toward wider dissemination and 
implementation of supported employment. As 
experiences and successes of supported employment 
are documented, it is .mportant to discuss voca- 
tional assessment/vocational evaluation in the 
supported employment process. There are a number 
of points to consilet regarding vocational as- 
s<^.^smer.t and vocational evaluation in relation to 
supported employment. 

First, is should be emphasized that sup- 
ported employment is not new. It is a term to 
describe a model of placement which is targeted 
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toward the most severely disabled individuals 
and which offers ongoing support for the duration 
of that individual's need on the job. Supported 
employment strategies have been used selectively 
in the past. With the impetus created by federal 
mandates and appropriations, it Is becoming more 
commonplace. 

The second point is one which is important 
to emphasize, not as a form of "bashing" but as 
an admonition to professionals. Simply stated, 
"the old ways won't work." Historically, voca- 
tional assessment has been used as a "gate keep- 
ing'' process to determine those persons who are 
eligible or ineligible for services in the voca- 
tional rehabilitation delivery system. Evalua- 
tors were asked to determine feasibility for 
services and for employ. lent. With the success of 
supported employment, such a gatekeeping function 
is outdated and ill-received. To quote the IRI 
Vggg 9f VOfifltl Qnal Rvfll u ation in VR document, the 
problems with the traditional vocational evalua- 
tion process are as follows: the methodologies 
were too setting specific; the activities and 
vocational experiences were not community based; 
the data collection was norm referenced on other 
rehabilitation linked persons and not referenced 
to the criteria of Job entry success; the ac- 
tivities were trait- oriented rather than work 
performance oriented; and the process appeared to 
be mere exclusive than inclusive. This meant 
that the process was used more to screen out than 
to identify resources to screen in. 

We have a choice as evaluators, to act as 
victors or as victims. Ve can allow the process 
to dictate our fate and to agree that evaluation 
is dead and has no applicat >n to supported 
employment. Or we can act as victors, confident 
in our discrete skills that we have much to offer 
the assessment process regardless of the setting 
in which it occurs. 

A third major point of consideration Is to 
emphasize that the exciting dimension of sup- 
ported employment is the opportunity to assess 
the individual and the environment more thoroug- 
hly. This form of assessment builds from a 
philosophy that there are meaning, value, and 
demands of work that each Individual, In working, 
espouses. The needs of each Individual "drive" 
the supported employment assessment process, in 
that it is not a question of employable or not, 
it Is a question of employable with what kinds ^f 
supports . 

The vocational ovaluator has skills In job 
analysis, behavior observation, and learning 
style assessment which are critical In the proc- 
ess of matching persons to jobs successfully. As 
victors in this process, we are also change 
agents, in changing our own thinking about our 
roles, as well as changing the thinking of 
others. Our destiny is In our own hands. 



Corthell, D.W. & Grlswold, p.p. (1987). The use 
.9f vocational eval iatf^n \^ ^P, Menomonle, 
WI: Research and Training Center, Univer- 
sity of Wisconsin-Stout. 



A Supported EmDlovT l^e ^ ^ ^p r s pective on Vocatlot^fl ^ 
Bvaluatiop 

David Hagner 

Any collection of information or data is 
meaningful only within a context of theoretical 
and value commitments (e.g. AcKroyd & Hughes, 
1981). Looked at from the other direction, given 
a set of un'^.^'.ying theories and values, it makes 
sense to ask some questions but not others; to 
collect some kinds of information but not others. 

It is important to understand one of the 
implications of this belief: that there is a lot 
of information that we shouldn' c collect. For 
example, we believe that prospective voters 
should not be evaluated for their literacy or 
their knowledge of civics. Since any adult 
citizen who is not a convicted felon has the 
right to vote, it is a W£.ste of time to collect 
"extra" information. If we believed, as people 
once di.d, that only people who met these other 
standaroi* should be able to vote, then such data 
collection would make sense. 

Vocati- i evaluation is no different from 
other type ' information gathering in this 
respect. No* ng frustrates evaluators more than 
receiving referrals without specific questions or 
issues that they are expected to address. Col- 
lecting i.^formation willy-nilly, without a clear 
idea of the context, is meaningless and--as the 
voting example illustrates- -potentially danger- 
ous. 

Supported Employfiienf jn Context 

So the best place to start to define what 
vocational evaluation should look like in a 
supported employment context is with the fun- 
damental theoretical and value premises of sup- 
ported employment. Supported employment can be 
briefly defined as paid employment for people 
with severe disabilities in Integrated settings 
with ongoing support. Although supported em- 
ployment services seem to some people to be a 
radically new idea, even a fad, Imposed on voca- 
tional rehabilitation from outside, nothing could 
be farther from the truth. Providing paid em- 
ployment has always been a central feature of 
vocational rehabilitation. Making services 
available to a broader range of people with 
disabilities has been part of the tradition of 
rehabilitation since its inception. The concept 
of integration- -becoming a participant in one's 
community rather tha\i set aside or .stigmatized as 
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different — is ir* ^rent in the meaning of "rehab- 
llitatioi " itsel. And ongoing support is simply 
an extension of the old-fashioned job modifica- 
tion process to include modified training and 
support services (such as job coaches) as well as 
modified physical features (such as ramps or 
wider aisles) . 

Supported employment evolved as a natural 
outgrowth of previous rehabilitation concepts and 
achievements. The projects with iiidustry initia- 
tive, the addition of on-the-Job-tr«ining arran- 
gements, the emphasis on severe disability, and 
the development of post -employment services all 
had a role to play as precursers of supported 
employment. In "'Zt, supported employment has 
always been with us in incipient forms. As one 
example, Tredgold's text on mental retardation, 
the classic text in use for several decades, 
discussed the work option that we call today the 
♦•work enclave" and included a photograph of 
several persons with mental retardation working 
alongside nonhandicapped co-workers in a factory 
(Tredgold & Soddy, 1909/1970, plate XXV). As a 
more recent example, Doane and Valente (1977) 
published an article about job coaching nearly 
ten years before an OSERS initiative established 
the current supported employment "fad." Like 
other new ideas in our field, supported employ- 
ment is the collective accomplishment of all of 
us . 

Uhut to As k anrf What Not to Ask 

Vocational evaluation must be regarded as 
an essential component of supported employment. 
But given the theoretical and value context, 
there are some nrtditional questions that it no 
longer makes sonso to ask or to collect informa- 
tion about. And, there are also some newer 
questions that do need to be asked; some non- 
traditional information that has to be collected. 

We no longer ask, for example, "Does this 
person have the skills to succeed in our pro- 
gram?" As a matter oc policy, we have decided to 
extend our services to a group that includes 
those with the most aevere disabilities. We can 
e' pect that some will have few skills and that 
our programs will have to be modified a» required 
to match t. e needs of our service recipients. 
Nor do wa ask "In which of a continuum of sett- 
ings " " day treatment , work activity , sheltered 
work, competitive work— does this person belong?" 
We already know that .special settin:s do not meot 
the integration requirement. We already know 
that vo be a part of one's community is to work 
in natural, not artificial settings. We don't 
assess people to determine who gets to be a part 
of their natural community any more than we 
assess people to dcteriiitne who gets to vote. We 
have replaced a continuum of settings with a 
continuum of support services. 



The questions that we do ask and need to 
answer in a su^jported employment context will 
usually be variations on these two: In which 
community settings is this person most likely to 
be successful? And what supports will be re- 
quired? Vocati':-;al evaluation can be thought of 
as the systec atic collection of Information 
relative to these two kinds of questions. 

A Model of Vocatio na.. Evaluation 

In order to collect enough of the right 
kind of Information, vocational evaluation will 
have to meet a number of requirements. First, 
since support will be provided on an ongoing 
basis, it will have to be long-terra in scope, 
encompassing both pre-employment and post -em- 
ployment phases. Second, since supported employ- 
ment utiiize*3 integrated settings, most evalua- 
tion activities will be conducted at the work- 
place or in other natural settings. Third, the 
job-seeker with a disability will not be the sole 
focus of evaluation, but work environments, co- 
worker attitudes, support systems, and so forth 
will be evaluated as well. The components of 
vocational evaluation are listed and briefly dis- 
cussed below. A forthcoming article (Rogan & 
Hagner, in press) will provide a fuller discus- 
sion of the model and its components. 

Pre-emolovn ifint evAluation. The abilities 
and preferences of job-seekors need to be as- 
sessed before a suitable job Is developed. 
Interviews with the Job seeker and with sig- 
nificant others and some review of previous 
records can provide such information. In addi- 
tion, participant-observation techniques can be 
employed as the evaluator and Job seeker eat 
lunch together or participate in some '/ther 
shared activity. 

A job-seeker's support system is the second 
focus of pre-employment evaluation. What resi- 
dential supports are available to assist a person 
in succeeding at a Job, and the impact of wages 
on family or personal finances, are each impor- 
tant. The location of a Job-seeker's home in 
relation to Job and transportation opportunities 
should also be assessed. These factors will have 
a direct Impact on recommendations for work en- 
vironments and support services. 

Third, the characteristics of potential 
work environments should be assersed. Worksite 
Inventories and Job analyses can assist in mat- 
ching abilities and interests to the demands and 
reinforcers of a Job. Workplace cultures can 
also be assessed (e.g. Wilkins, 1983) to deter- 
mine the potential and requirements for social 
integration. 

pt;>fft;.^.pipl ovment e valuation . The acquisi- 
tion of ta.sk skills can be assessed usii both 
task analysis data collection and employe^: In- 
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terytewa. The integration of the supported 
employee- -hii o her assimilation into the cul- 
ture- -should no;: be merely assumed, and can be 
assessed through direct observation and Inter- 
views. And finally, the job satisfaction of the 
supported employee must be assessed, and the 
information used to assist the ^ronloyee to make 
career development decisions through a series of 
Jobs, if need be. 
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EK^gttVO Vocational AaaeBan^ t^ p t ^ in Stipp r^|;<;^rj 
Emplovroent . 

Genni Sasnett 

St. John's Child Development Center oper- 
ates a supported employment program for persons 
with severe disabilities in Washington , D.C. The 
individuals served by St. John's have a variety 
of disabling conditions including deaf -blindness , 
mental retardation, autism and cert;bral palsy! 
The individuals work in paid employment positions 
in the comniunity with Job coach support. 

Vocational assessment for the individuals 
St. John's serves is accomplished in a couple of 
ways. Some of the individuals come to St. John's 
through public and private school systems. With 
these individuals, vocational assessment takes 
place over a very extended length of time. The 
process begins while students are still in school 
when they are approximately aged fifteen. At 
that time, the students begin being involved in 
community work experiences in a volunteer capac- 
ity. Students participate in these work ex- 
periences for several hours per day, one to five 
days per week. Ideally, the students rotate 
through three separate work experiences each 
school year. Assuming that the students remain 
in school until age twenty-one, this process 
allows them the opportunity to participate in as 
many as eighteen separate experiences during 



their school years. Attempts are made to expose 
students to as many different types of jobs as 
possible. They may repeat an experience with a 
certain type of job but the setting always chan- 
ges. Data on students' rate of productivity 
level of supervision required, level of interest 
observed or expressed, as well as other relevant 
information is collected by staff who accompany 
the students during their work experience. This 
data is summarized in a work training site report 
which is generated at the end of each individual 
work experience for each student. The informs- 
tion in the work training site reports is then 
summarized in an annual work experience report at 
the end of each school year. This report becomes 
part of the stvident's school record. By the time 
the student exits school he or she should have as 
many as six annual reports with data on perform- 
ances at a variety of Jobs. 

Students are referred to the local voca- 
tional rehabilitation agency at the time their 
school work experience begins. Vocational reha- 
bilitation and the school system work together to 
identify appropriate adult services agencies to 
take over service to students when they exit 
school. St. John's is one of those adult service 
agencies. St. John's enters students' liven 
during their final year in school. When we 
enter, we begin our vocational assessment pro- 
cess. The process starts with a thorough record 
review to determine important medical, psycholog- 
icfl, social, educational and vocational informa- 
tion. The school volunteer work experience 
information is included in this section. If 
appropriate, St. John's may conduct standardized 
testing as a next step. It should be noted, 
however, that this is done only in rare cases 
The nature of the disabilities of the individuals 
St. John's serves generally make standardized 
testing inappropriate. St. John's staff occas- 
ionally use a reading free interest inventory 
Next, we conduct behavioral observations in a 
variety of settings, e.g. the school, a work 
training site, the home. Finally, we conduct ^ 
comprehensive home interview with the family or 
residential service provid<.r and the individual 
being assessed. In il.is interview we focus 
heavily on determining the level of support the 
family or extended family may be able to provide 
to the individual in his or her endeavor to 
become employed. We also look at neighborhood 
employment resources, skills and interests in the 
home and, finally, we ask the individual being 
assessed and his or her family to suggest the 
type of employment that would be desirable and 
appropriate . 

Using all of the information above, lists 
of strengths and needs are developed and types of 
sp;icific employment are proposed. Employment is 
then sought by St. John's Job developer who does 
very close follow-, ip with employers, workers and 
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Job coaches after employment commences to ensure 
that the Job match was an appropriate one, St. 
John's staff work in conjunction with school 
personnel throughout this placement in paid 
employment. The student exits school with no 
interruption in his or her employment. School 
job coaches and other personnel fade out as St. 
John's staff assume the coaching and support 
roles. 

In some instances , St. John' s receives 
referrals for service for individuals who are not 
a part of a school program, These are often in- 
dividuals who have been out of any type of pro- 
gram for a substantial amount of time. In these 
cases, we are limited by the fact that we do not 
have the extensive work experience data which we 
have from students exiting school programs, St. 
John's approach to vocational assessment remains 
the same as with school students, however, with- 
out the work experience data, the emphasis on 
behaviors'' observations and home interviews is 
much greater. When a Job placement is made it is 
conaidered more tentative based on the fact that 
our assessment ia done using limited information. 
The follow-up i« done very closely and transfers 
to new employment are made when necessary. 

In a number of cases these individuals come 
to St. John's with vocational evaluations done by 
vocational rehabilitation or a private evaluation 
facility. Most of these evaluations recommend 
sheltered workshop placement or suggest that the 
individual evaluated is "unemployable" and, 
therefore Is appropriate for day program place- 
ment only. In spite of these recommendations, 
St. John's has found that these individuals are 
capable of working in competitive supported 
employment positions. The question that must be 
asked Is why these individuals come to St. John's 
with such limiting evaluations and yet clearly 
show thsMselves able to accomplish a great deal 
more. The answer lies in two significant areas. 
The first area is the assessment of service 
options. If evaluators were assessing these 
individuals to determine where on the traditional 
continuum of service options, such as train and 
place and sheltered employment, these individuals 
could best be served, then the evaluations are 
accurate. But with the advent of the supported 
employment models and concepts such as "job shar- 
ing" in which individuals combine abilities to 
share the duties and pay of a single Job, the 
evaluations are not accurate. The field of 
opportunities has expanded significantly. The 
second area is the area of assessment techniques. 
Persons with severe disabilities cannot be ac- 
curately assessed using much of the technology 
tre^ditionally used in vc cational assessment. 
There is a prevalence of certain characteristics 
among persons with severe disabilities, such as 
communication impairment, difficulty with trans- 
ference of learning and negative reaction to 



abrupt change, that make techniques such as 
standardized testing, work sampling and be- 
havioral observation, when done in an unfamiliar 
environment, very ineffective. Conclusions drawn 
from assessments which do not take into con- 
sideration the special characteristics of a 
particular population cannot be considered to be 
reflective of a person's f -ilities, aptitudes or 
interests . 

Vocational assessmeac does have a role in 
supported employment in the sense that in order 
to provide service to an individual a determina- 
tion must be made of what service i s needed . 
That determination should not be whether an 
individual will have an opportunity to become 
employed but rather what support will be needed 
to enable them to take advantage of employment 
opportunity, Evaluators have an interesting 
challenge before them to educate themselves to 
the special characteristics of persons with 
severe disabilities and to the newest employment 
service options and, also, to adapt current 
assessment technology. Evaluators must also take 
advantage of the opportunity to act as change 
agents in their communities by not limiting their 
recommendations to the service options provided 
by local rehabilitation agencies. Evaluators 
must make recommendations which they feel will 
best serve the neeuj of the individuals they are 
assessing and lobby to have service options 
developed in their communities which will meet 
those needs. 
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JOB MATCHING SYSTEMS: ONE DIFFERENCE IS THE DATA 
JEFFREY A. TRUTHAN, MS, CRQ CVE 



Abstract 

The use of computerized joo matching 
systems carries with it the responsibility to 
fully understand the data being manipulated. 
Commercial computerized job matching 
systems use various occupational codi ng struc- 
tures as a basis for job matching. Since each 
coding structure was developed for a different 
purpose, there is a very different perspective 
on how occupations are defined and grouped 
for the purpose of that code structure. This 
article examines the most commonly used 
coding structures, demonstrates the differ- 
ences, and draws some important conclu- 
sions for vocational planning and expert tes- 
timony. 



Computer technology enables vocational profes- 
sionals to conduct a vocational analysis in minutes 
instead of hours. The use of a computer frees the 
professional from the mundane drudgery of manually 
comparing client characteristics (skills, interests, apti- 
tudes, education, worker traits, limitations, and prefer- 
ences) to the demands of occupations. But whether 
the resulting vocational analysis is complete and com- 
prehensive is entirely dependent upon the defined 
purpose of the occupational coding structure used by 
the computer program. 

The ease and speed with which vocational data 
can be sorted by the computer can be misleading (and 
consequently misinterpreted) without an understand- 
ing of the data being manipulated by the computer. 
This article examines the occupational coding struc- 
tures most commonly used by commercial job match- 
ing systems. 

Sources of Occupational Data. 

There are a number of different sources of occupa- 
tional data, each published by adifferent branch of the 
federal government. Each government agency had its 
own needs and perspective in mind when it classified 
occupations. 

Dictionary of Occupational Titles (DOT). 

The Department of Labor (DDL) has been charged 
with the development of methods for classifying infor- 
mation about occupations. Since 1 939, the DOL has 
produced four versions of the DOT, the most recent of 
which includes the Fourth Edition and Its Supplements 
(US DOL, 1 977, 1 982, 1 986). In the early 1 970's, the 
DOL published the Handbook for Analyzing Jobs {US 
DOL, 1 972), a standardized method for collecting and 
reporting occupational data. The Handbook for 
Analyzing Jobs (HAJ) was an extension of earlier 
developmental work, but also established for wide- 
spread use important definitions of many coding struc- 
tures and worker traits, including physical demands 
environmental conditions, training time, aptitudes' 
temperaments, and interests. 

The HAj introduced two new coding structures to 
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help describe the work performed in a job. These new 
coding structures are called WORK Fields and Mate- 
rials, Products, Subject Matter, and Services (MPSMS). 
WORK fields codes characterize the machines, tools, 
equipment, and work aids used by thf? worker or 
describe the socio-economic purpose of the work. 
Methods verbs are also used to denote the specific 
methods for getting the work done. The MPSMS code 
structure indicates the materials processed or the 
products produced by the worker, the data or subject 
matter contemplated, and/or the services provided by 
the worker. 

There are 1 03 three-digit codes assigned to de- 
scribe the WORK fields; there are 580 three-digit 
codes to describe the MPSMS of the occupation. Each 
of these three-digit codes is a discrete category. The 
coding was carefully done so that at a two-digit code 
level, categories with the same first two digits are 
clustered together into logically related groups. The 
DOLencouragedthe use of several WORK and MPSMS 
codes per occupation to adequately describe the work 
performed in an occupation. 

The method of sentence analysis mandated in the 
HAJ caused the narrative job descriptions to be written 
In such a manner as to reflect these two important code 
structures (WORK and MPSMS codes). The impor- 
tance of these codes to an accurate assessment of the 
isferability of the skills of the worker was empha- 
.zed by Botterbusch (1986). Most computerized job 
matching systems use the DOT as its source of occu- 
pational data. Only a few use WORK and MPSMS 
codes in its matching process. The transferability 
process using these codes was originally developed in 
1981 (Watters, 1985). 

Standard Occupational Classification (SOC). 

The Department of Commerce did not need the 
elaborate DOT method of classi /ing occupations, 
since it was concerned with the nature of occupations 
in the US economy especial ly as compared to the labor 
force of other countries. Accordingly, the Standard 
Occupational Code Manual (US Department of 
Commerce, 1980) was developed using a four-digit 
code. Each additional digit in the SOC code adds finer 
detail to the occupational structure, which lends itself 
to statistical analysis and tabulation. There are only 
649 SOC codes which cross reference to the DOT 
codes. Job matching systems based on SOC codes are 
usually those sponsored by the State Occupational In- 
formation Coordinating Committees (SOICC). SOC 
based systems work wel I forthe non-disabled, general. 



and student populations, but have limited application 
to rehabi I itation or special education populations since 
the Department of Commerce did not collect any 
worker trait data on SOC codes. 

CENSUS Codes. 

The Bureau of Census (1980) developed its own 
occupational classification structure, which is fairly 
consistent with SOC codes, but even more simple 
since it consists of only 473 three-digit codes. The 
ccmparatively small number of occupational codes 
works well for the Census Bureau, which uses semi- 
skilled interview workers to assign occupational codes 
to the information self-reported by the interviewees. 
Data cannot be aggregated or clustered using CENSUS 
codes since the numbering method is sequential rather 
than categorical. CENSUS codes are popular since 
they are used in County Business Patte ; and some 
wage and employment statistics are available. How- 
ever, like SOC codes, no worker trait information was 
gathered by the Census Bureau. 

Guide for Occupational Exploration (GOE). 

While not truly an occupational coding structure, 
the DOL (1979) introduced the GOE. Intended as a 
counseling tool for Employment Service counselors, 
the GOE structure groups DOT occupations by a six- 
digit interest code. The 350 GOE codes were used to 
group occupations based on ^the broad interest re- 
quirements of occupations as well as the vocational 
interests of individuals^ GOE codesare a popular way 
to conduct vocational exploration and career plan- 
ning, but do not work well as an accurate mechanism 
for skills transfer. Having an interest in an activity 
cannot be construed as possessing a trained skill in 
performing a certain kind of work method, using 
certain tools and machines, etc. 



Data Interrelationships 

The only government coding system based on 
detailed, on-site job anal/ses by trained occupational 
analysts is the DOT. All other occupational code 
structures are a simple derivative of the DOT, with 
little else than a brier, general description of job duties 
and a cross-reference to the DC codes which consti- 
tute that group. The DOT is the only source for any 
kind of worker trait information. T^ se data relation- 
ships are best represented by Figure 1 . 
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Figure 1. Relationships of the various occupational code structures. 

The number associated with each data resource 
indicates the number of different codes used by that 
coding structure in relation to the DOT. For example 
aitho«igh the CENSUS code structure contains 503 
occupational codes, only 473 have been cross ref=»r- 
enced to the DOT. The same is true for SOC codes, 
where certain SOC codes have no corresponding DOT 
code(s). 

Most Important about Figure 1 is the d;.actional- 
•ty of the relationships. Every DOT code has one 
unique set of worker traits. Each DOT code has one 
corresponding SOC, CENSUS, and COE code and it 
has one or more WORK field and MPSMS codes 
assigned. For the most part, there is a simple one-to- 
one relationship of the DOT to the other code struc- 
tures. However, the inverse relationship is quite 
different; it is one code to many DOT codes. One GOE 
code (for example, 05. 1 1 .01 - Equipment operations, 
construction) refers to many DOT titles (there are 64 
DOT occupations within this GOE subgroup). The 
same is true for nearly ail other instances of the other 
code structures. This Inverse one-to-many relation- 
ship (s critical to the appropriate interpretation of 
vocational data, since important employment and 
wage information is predominantly collected using the 
abbreviated occupational coding structures, not the 
DOT code structure. 



Data Differences 

Each government agency collects occupational 
data using the coding format suitable for Its intent. For 
example, the Bureau of Census uses their simple 



system to make It easy for semi-skilled Interview 
workers to assign an occupational code. It Is tempting 
to use CENSUS data to quote wage information, but It 
must be done with great caution since any one CEN- 
SUS code refers to many DOT codes. The wage eiata 
thus quoted might be accurate for the CENSUS group 
as a whole, but not likely In the context of one or two 
of the DOT titles which an Individual might be able to 
perform In that CENSUS group following an injury 
The same interpretation pi ,^blems occur when quoting 

employmentstatisticsor labormarket projections based 
on CENSUS or other occupational code structures. 

That each code system contributes a different per- 
spective to an understanding of occupations is best 
understood through an example. Let us consider an 
apparently "pure" svork activity such as stationary 
engineering. The three-digit WORK code for station- 
ary engineering is 021 , -producing and/or distributing 
heat, power, or conditioned air". A search through the 
DOT and its Supplements identifies 52 occupations 
which primarily involve this WORK code. These 52 
occupations range from sedentary to medium strength 
and cover an SVP range of 2 to 8. Further examination 
of these 52 DOT occupations reveals 8 different slx- 
digit GOE interest codes for the WORK of stationary 
engineering, 13 different CENSUS codes, and 16 dif- 
ferent SOC codes (See Table 1). 

The six-digit GOE Interest code for stationary engi- 
neering is 05.06.02. A search of the DOT finds that 
only22 DOToccupationsfall into this GOE subgroup, 

whichencompassesthreedifferentWORKcodes(most 
o^hich are WORK = 021). The three-digit CENSUS 
code for stationary engineering is 696, which identi- 
fies only 12 DOT occupations (each of these 1 2 have 
a WORK code of 021) but these twelve DOT codes 
refer to 4 different COE codes. The SOC code for 
stationary engineering Ic 693 1 , which identifies only 6 
DOT titles, all of which are WORK code = 021, but 
which reveal 3 different GOE codes. 

It should be clear that the occupational groupings 
are very different depending upon the code structure 
used With such startling differences in an occupa- 
tional example as ostensibly "pure" as stationary 
engineering, the vocational professional Is at a loss to 
explain where the 40 DOT occupations went which 
are known to involve the WORK of stationary 
erigineering (WORK code « 021) if there is exclusive 
reliance on only one occupational code structure such 
as the CENSUS code for stationary engineering, which 

fu^^A^^o ^ ^ "^^^^ " occupations which Involve 
the WORK of stationary engineering. 
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Table 1 presents a frequency count of different oc- 
cupational codes as arranged by the primary WORK 
codes. These frequency counts clearly underscore the 
heterogeneity of the groups. On average, there are 24 
different GOE codes per WORK field, 23 different 



CENSUS codes per WORK field, and nearly 28 differ- 
ent SOC codes per WORK code. (Similar frequency 
counts for GOE, CENSUS, and SOC codes are avail- 
able through the author upon request.) 



TABLE 1. FREQUENCY COUNTS OF CODES WITHIN EACH GROUP 



WORK 
CODES 



Total 
Titles 



GOE Codes 
Total Min Max 



CENSUS Codes 
Total Min Max 



SOC Codes 
Total Min Max 



001 
002 
003 
004 
005 
006 
Oil 
012 
013 
014 

031 

032 

033 

034 

041 

042 

043 

051 

052 

053 

054 

055 

056 

057 

061 

062 

063 

071 

072 

073 

081 

082 

083 

091 

092 

093 

094 

101 



21 
15 
133 
52 
10 
23 
182 
184 
128 




WMmm> 
314 

103 

18 

52 

75 

bJ 

77 

312 

11 

74 

427 

149 

108 

134 

262 

183 

198 

27 

27 

13 

46 

11 

32 

16 

26 

19 

19 

43 



3 
2 
13 
8 
3 
4 
43 
26 
40 



56 
17 
7 
8 
27 
21 
19 
43 
9 
22 
61 
20 
25 
23 
39 
31 
44 
10 
11 
7 
18 
10 
19 
3 
8 
6 
12 
18 



19 
13 
51 
14 
5 

13 
63 
46 
17 

..........dL-.-., 

84 
30 
10 
30 
11 
31 
27 
43 

2 
IS 
58 
46 
28 
40 
83 
34 
19 
11 

9 

3 
11 

2 

5 
12 
12 

9 

4 

9 



5 

3 
17 
17 

4 

8 
41 
37 
39 
27 

illi 

52 
17 
13 
14 
15 
17 
23 
42 

8 
20 
46 
28 
18 
29 
32 
25 
31 

8 

10 

5 
11 

8 
11 

5 
14 
10 
11 
15 



12 
11 
47 
9 
7 
9 
58 
37 
14 




31 
3 

14 
21 
22 
13 
76 
3 
22 
89 
33 
46 
29 
132 
32 
54 
19 
9 
4 
31 
3 
17 
7 
8 
6 
3 

19 



5 
4 
26 
16 
4 
9 
44 
39 
40 



1 
2 



18 
13 
15 
19 
17 
24 
50 

8 
25 
62 
36 
27 
34 
39 
28 
38 

9 
12 

6 
13 

8 

^^ 

5 
16 
10 
11 
16 



12 
9 

27 
9 
7 
9 

58 
37 
10 



55 
32 
3 

15 
19 
22 
13 
51 
3 

13 
77 
18 
46 
28 
104 
26 
39 
17 
5 
4 

17 
3 
7 

5 
5 
5 
3 
18 



Note: 



Min is he minimum number of DOT occupations found in any cell 
Max is the maximum number of DOT occupations found in any cell 



NATIONAL FORUM 



TABLE 1. FREQUE NCY COU NTS OF CODES WITHIN EACH GROUP (continued) 



WORK 

CODES 



Total 
Titles 



102 

111 

112 

121 

122 

131 

132 

133 

134 

135 

136 

141 

142 

143 

144 

145 

146 

147 

151 

152 

153 

154 

161 

162 

163 

164 

165 

170 

171 

181 

182 

183 

191 

192 

201 

202 

211 

212 

221 

231 

232 

233 

241 

242 



823 

293 
63 

472 
33 
78 

188 
66 

247 

123 
93 

186 

142 

219 
38 

219 

285 

397 
91 

151 

151 

23 

52 

41 

141 

68 

35 

10 
227 

11 

19 

35 
173 

53 

49 

30 
714 

80 
208 
274 
262 
8 

70 

55 

Note: 



GOE Codes 
Total Min Max 

98 ~ 
83 
10 
111 
7 
17 
24 
12 
51 
27 
12 
22 
31 
49 
7 
52 
103 
58 
24 
57 
45 
8 
18 
13 
28 
15 
5 
4 

102 
3 
6 
16 
27 
5 
21 
19 
261 
45 
45 
53 
48 
1 

14 

50 



80 
36 
20 
49 
16 
22 
45 
24 
47 
34 
33 
33 
35 
37 
14 
41 
21 
44 
26 
28 
33 
10 
14 
16 
28 
18 
14 
5 
24 
7 
10 
11 
37 
25 
11 
7 
87 
19 
42 
51 
39 
8 
23 
5 



CENSUS Codes 
To!a! Min Max 



104 
46 
18 
62 
22 
20 
28 
15 
40 
24 
27 
24 
21 
22 
9 
21 
37 
32 
18 
22 
29 
9 
9 
11 
21 
18 
13 
4 
26 
7 
12 
14 
28 
20 
12 
6 
93 
15 
45 
73 
49 
6 
24 
12 



157 
46 
16 
59 
4 
17 
33 
20 
25 
27 
14 
57 
74 

145 
22 

125 
58 

101 
23 
59 
37 
13 
30 
17 
39 
18 
10 
6 

125 
4 
4 
9 

52 

12 

13 

16 
276 

23 

28 

23 

39 
2 

11 

37 



SOC Codes 
Total Min Max 



129 
56 
23 
73 
24 
24 
36 
18 
58 
36 
31 
27 
22 
28 
11 
25 
41 
41 
22 
26 
33 
11 
11 
13 
26 
23 
16 
4 
29 
7 
11 
15 
39 
23 
16 
10 
103 
14 
48 
80 
55 
6 
26 
13 



149 
46 
12 
59 
4 
17 
32 
17 
22 
22 
13 
55 
76 
145 
19 
92 
51 
94 
23 
59 
37 
9 
28 
15 
38 
14 
7 
6 

125 
4 
4 
9 

37 

12 

11 

14 
275 

23 

28 

23 

39 
2 

11 

37 



Min is the minimum number of DOT occupations found in any cell 
Max IS the maximum number of DOT occupations found in any cell 
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TABLE 1. FREQUENCY COUNTS OF CODES WITHIN EACH GROUP (continued) 



WORK 
CODES 



Total 
Titles 




CENSUS Codes 
Total Min Max 



see Codes 
Total Min Max 



243 
244 
251 
261 
262 
263 
264 
271 
272 
281 
282 
291 
292 
293 
294 
295 
296 
297 
298 
299 



6 
37 
36 

8 

16 
2 

14 
51 
4 
25 
49 
46 
43 
34 
33 
64 
37 
11 
5 
2 



1 
1 
1 
1 
1 
1 
1 
1 

2 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 



7 
28 
15 
24 
20 

5 
23 
29 
11 
15 

9 
33 
82 
16 
27 
167 
41 
26 

3 

1 



mmMmmmm 



8 
42 
42 
10 
17 

2 
14 
55 

4 
24 
52 
47 
69 
35 
33 
93 
43 
12 

5 

2 




Note: Min is the minimum number of DOT occupations found in any cell 
Max is the maximum number of DOT occupations found in any cell 



Implications for Vocational Planning 
and Expert Testimony 

This analysis clearly demonstrates that each occu- 
pational coding structure is very different from the 
others. Each structure contributes an additional per- 
spective on the definition of occupations. Reliance on 
a singular coding structure to depict the world of work 
to a disabled or displaced worker may be overly re- 
strictive of true occupational options and overlook 
some feasible opportunities. 

Exclusive use of one approach in expert testinr>ony 
can be easily refuted through review of Table 1 or any 
of the author's supplementary tables. Diminished 
access to the labor market may be substantially mis- 
represented and overstated. In the stationary engineer- 
ing case, if a worker could only perform a maximu.Ti 
of light lifting, the WORK code identifies 30 sedentary 
and light occupations (57% of the 52 total in this 
WORK code) vs. the 4 light jobs of the 12 CENSUS 
code stationary engineers (33%). There is a huge 



difference in how this information impacts upon a set- 
tlement in a litigated case. 

Valid vocational planning and expert testimony 
by the professional must recognize these enormous 
structural differences. Now that computer technology 
has removed the onus from the task of vocational 
analysis, we are free to reconsider the basics of what 
the data represents. We can study the HAJ to recon- 
sider our methods of analysis and expand our reper- 
toire of vocational tools. Recognize that the DOT is 
still at the center of all of the other cede structures and 
that all worker trait i nformation is associated with DOT 
codes only. Remember the issue of directionality 
when crocs referencing between coding structures. 
Exercise caution in interpretation of data based on 
cross-referenced codes. 

When choosing a computerized job matching 
system or reviewing a report produced by one of them, 
look for flexit'lity and variety in the approaches to 
searching the data. Do not rely exclusively on one 
coding structure or job matching system unless it has 
the flexibility to search on a variety of occupational 
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Abstract 

This paper '•cvtews selected literature ••elated 
to g1v1-j testimony as a vocational expert. It 
concludes with a discussion of an active 
Worker s Compensation case, the first time court 
experiences of the author. Information Is 
provided on the evaluation process as well as 
the court experience. R""nmendat1ons for pre- 
trial preparation are made. 



History 

Where did It all begin? There Is some 
opinion that vocational expert testimony began In 
the early i960 s in the area of social security 
disbursements (May, 1983; Harper, 1985). rtost 
often, the Kerner vs. Flemming decision Is cited 
as the major reason for the advancement of 
vocational expert testimony as the U.S. Office of 
Hearings and Appeals required the use of 
vocational experts in a vast array of disability 
cases. After this time, the growth of such 
testimony was quite remarkable (Brandon, 1983). 
Vocational experts have been called to work on a 
variety of cases such as divorce, product 
liability, worker's compensation, and personal 
liability (May, 1983). They have also been 
Involved when catastrophic loss has occured 
(Deutsch and Sawyer, 1987). 

Who Does It 

Brandon (1983) makes a distinction between 
fhe profesalonal witness" and the "expert 
»»ltnejia.'.'' ■ •Th«^€nr»»«r;renjrei»ent« ,* ♦'le-r* 
vocational knowledge and legat expertfse, a sort 

.J^.V^'^ 9""*" the latter Is a 

rehabilitation professional working In the field, 
^he expert witness has the added benefit of not 
only being able to speak to issues theoretically, 
" ^^''1 (Rasch, 1985). Walker 
(1985) reports that full-time practitioners are 
preferred because of their Involvement in the 
field. Walker also feels that they cost less 
than professional witnesses and any comnunication 
problemscan be easily cleared up. While Field 
and Sink (1981) stated that a bachelor's degree 
and experience were necessary minlmtms. Harper 
(1985) wrote from the prospective of a 
rehabilitation counselor and noted that a 
master s degree, certification and experience 
were all minimum requirements. Professional 
qualifications can come under very close 
scrutiny, depending on the complexity of the case 
(Deutsch and Sawyer, 1987). Whichever author's 
group we choose to follow, experience is still 
noted as a major reason for selection of experts 
by attorneys. 

What Happens 

The actual courtroom experience geterally 
follows the pattern of estabHshmer t of 
qualifications, direct examination fro i the 
plaintiff s attorney, cross-examination from the 
defense attorney and a "redirect" back to the 
plaintiff s attorney. This last activity allows 
for a summation of the pertinent points of the 
case and a chance to clear up any confusion 
brought on during the cross-examination. 
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Do's and Donets 

Reviewing the literature reveals that a 
nytnber of authors offer advice on what or what 
not to do. The l^ollowin^^^is « comprehensive 
list obtained from Rasch (1985), Deutsch and 
Sawyer (1987\ and Harper (1985). 

(1) Be polite and courteous at all times - 
don't "blow your cool." 

(2) Be honest. 

(3^ Think he.fore. yon sneak. 

(4) Speak clearly and audibly. 

(5) Beware of flattery. 

(6) Questions that can be answered by 
•yes* or *no' should probably be 
handled that way. 

(7) Don't get humorous or frivolous. 

(8) If you make a mistake, correct 
yourself. 

(9) If you don't know, say so. 

(10) Avoid technical terms - your job is to 
educate. 

•(11) Try to anticipate where the attorney 
is going. 

(12) Do not speak for other experts and do 
not go outside your arei of expertise 
or what your were asked to do. 

(13) Keep materials on the stand to a 
minimum. 

(14) Dress conservatively. 

Typical Questions Asked 

Deutsch and Sawyer (1987) provide a 
coinprehensive_list of questions which can.be 
broken down into two Bcenarioa, the non-' 
catastronhic iniury and the catastrophic caa«. 
Some questions related to professional 
qualifications cross over Into both areas. 
Nonetheless, examples of questions include: 

(1) Did you meet with the client? 

(2) Where did the meeting take place? 

(3) What was the purpose of your 
evaluation? 

Was the client alone? 

(5) What procedures did you use? 

(6"^ HrlAflt dftRp.rihe your finuings. 

(7) Discuss the instrument you used. 
Harper (1985) presents a list similar to the 
above. 

Defense Strategies 

For those afraid that they will corne under 
severe attack in the courtroom, take some solace 
in the following as McLeod (1988) writes: 
"It Is an accepte'' rule in trial 
practice that counsel should not 
attempt to upstage a specialist in his 
own field. It rarely gets results, 
(pg- 80) 

This quotation from a lawyer should help 
those who fear that the defense lawyer may try 
to show that they know more about the field of 
vocational evaluation than the expert witness. 
Baun. (1987) also acknowledges the hazards In 
launching personal attacks on expert witnesses 
and goes on to offer the following advice to 
defense attorneys. 



(1) Attorneys should learn all they can 
about the expert as a witness* 

(2) Start the cross-exatnlnatlon with 
commonly acreed upon oolnts . 

(3) Stay to low risk questions. Do not get 
too bold or outrageous as this Is the 
sign of a weak case. 

He also states that, occasionally, attorneys will 
attack the financial gain of the expert. 

Summary 

The foregoing has been a selected review of 
the literature related to giving expert 
testimony. Although brief, it highlights the 
aceas that most novices will find interesting. 
The following case presentation will offer a 
comparison of what happended in one particular 
case. 

The Case 

Thi Jient was a 48 year old laborer with a 
4th grade education. He had worked most of his 
life at such jobs as farming, service-station 
attendant , 1 umber mi 1 1 worker, rai.l road track 
repairer, sandblaster, and general foundry 
worker. This latter position was his most recent 
and he had held the job for approximately 11 
years, up to the time of the accident. He was 
twice divorced and had an adult daughter. He 
lived with his mother. 

The client claimed that he "woke up' in the 
emergency ward of the local hospital. He did not 
know how he got there. Apparently, some 
co-workers found him unconscious on the floor of 
the foundry. Somewhere along the line it had 
been determined that he had been hit on the head 
and his Injury had occured while he was working. 
There was subsequent back surgery with the 
removal of two discs. Later medical complaints 
proved to be groundless and one medical doctor, 
while assigning a 25% permanent Impairment rating 
with lifting restrictions of 35 pounds, also 
suggested the 1 ndi vi dual was mal i ngeri ng . 
Nonetheless, the client was now suing for 
worker* s compensation. 

Before the client arrived for our apoint- 
ment, I was sent medical reports as well as the 
report of a consulting psychologist. The 
psychologist determined that the client had a 
full-scale I.Q. of 57 and that there was 
depression and anxiety present that were 
contributing to this individuars inability to 
not only hold a job, but to handle his own 
financial affiars. 

The client arrived on time with two family 
members* Neither stayed for the morning s^^ssion. 
The procedures consisted of the following: an 
extensive interview followed by testing with the 
Woodcock- Johson Psychoeducational Battery, and 
the Valpar Number 9, full body range of motion. 
The client was extremely vague and seemed 
bewildered by the entire process. Reading and 
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math achievement levels eventually placed him at 
the Grade level. 

Following the testing process, computer job 
SAflrch progrflmfl were utilized to determine loss 
of access to both national and state labor 
markets. The two programs were the OASYS Job 
Search Program and the Labor Market Access (LMA) 
Program. Both systems give some measure of pre- 
and poat-accident access to the labor wV.et. 
The classification of Jobs (Field & Field, 198A) 

l^lVrf''' mE^^^'®^' ^^"^^ °" psychologist's 

report, my own assessment, and the medical 
restrictions, the client seemed to be In very 
poor shape with respect to opportunities In the 
labor market. 

Now that I had my Information. I needed 
some courtroom survival skill -training. For 
this I turned to two hardened veterans of the 
litigation scene who graciously offered to 
question me with typical questions they had been 
asked In court. Fortunately, one even assumed 
the demeanor of a blustering defense attorney 
which, not only exposed me to content, but to 
effect as well. I was ready. Or was I? 

There was little pre-trial consultation 
with the attorney. A plione call and a fairly 
quick discussion of the case was all that 
happened and we were ready for the opening act, 
the deposition. The deposition is a pre-trial 
event during which the defense attorneys have 
the opportunity to find out who you are and what 
you are likely to say in court. It take*: place 
in an office. I was warned that they could take 
up to three or four hours, although it was not 
expected this one would be very long. I was 
also forewarned that .the ..defense attorney in. 
this case was a "nice" man but not to 
underestimate him. 

I arrived for the deposition slightly ahead 
of schedule. It took place at our attorney *s 
office. I took my notes, medical and 
psychological reports, as well as computer 
printoutsfrom the job search pr-ograms. I had 
been pre-ad vised to take nQthin^ into the office 
that I did not want to have brought into 
evidence or questioned in any way. We met in a 
cotiference room and onXv mvflelf, our client's 
attorney, the defense attorney, and the court 
reporter were present. I was offered coffee and 
we made some polite off-the-record conversation. 
And then we started: 

(1) State your name. 

(2) What are you doing in Auburn? 

(3) Have you had occasion to meet with 
Mr. ? 

(4) Did you perform any testing on Mr. 

? 

(5) What conclusions did you arrive at? 

(6) Did you use any other materials to 
arrive at your conclusion? 

(7) Do you have any information with you 

on Mr. 's former jobs? May I 

copy It. 

And that was It. What I thought was going 
to be a long, arduous experience was over In 
seven minutes. Total time in the office was no 
more than ten minutes. I barely had one sip of 
coffee before my first deposition was finished. 
Jty informants were right. The defense attorney 
seemed like a nice man. 



Later that month came the trial. I arrived 
at the court slightly ahead of schedule. The 
defense attorney was also there and we once a^ain 
made polite conversation outside our appointed 
courtroom. A-previoua tria.** was still in 
progress. Eventually, my client's attorney 
arrived but our client was nowhere to be found.' 
He had been at the lawyer's office well over an 
hour ago but we feared he may have gotten lost 
rlndlng^ths^courtroom. Worraally, the drive is 

?!?«J*f:/^^^1®"."^^""^®«' Eventuallv. he and hlfl 
family arrived. I was the first witness called. 
Standing outside the room waiting to be called I 
felt a bit nervous but excited at the same time. 
This was it. This was one of the reasons I came 
to Auburn. My very first trial. 

I was called in. The courtroom was largely 
empty except for the judge, the defense attorney 
and an associate, my client and his family, and 
his lawyer. There was only one unkown female In 
the court. She left immediately after my 
testimony and her identify was never established. 
I was sworn in. My client's lawyer was the first 
to ask questions and he basically followed the 
lines of the deposition. Then it came time for 
the cross-examination. This nice defense 
attorney rose from behind his desk, puffed out 
his chest, began to bluster and walked toward me. 
At this point. I remembered my blustery rehearsal 
and began to smile. And he smiled, but quickly 
reverted to his professional s-'owl. He 
reiterated a few things already discussed and 
then the sequence approximated the following: 
Attorney: Sir, you «ay .this man worked^ on a- 

farm. Is that correct? 
Me: Yes sir. 

Attorney: Have you ever worked on a farm? 
Me: No sir. 

Attorney: Well, I've never been to Auburn and I 
don't have all your degrees but I've 
worked on a farm. I know whaFlt 
takes to do farm work. Tell me, sir. 
can this man lift a cow's tail and 
wash its rear end? 
At this point, the court broke out laughing. The 
judge, our client's lawyer, the defense associate 
and the lady of mystery were all laughing. I was 
sweating. Once the laughter died down, everyone 
was looking at me for a response. To this day. I 
do not remember what I said. 

Temporarily, the defense attorney shifted 
his line of attack. We got to the issue of 
malingering. Some of the questions included: 

- Do you think this man is malingering? 

- A noted neurological surgeon with years of 
experience has said he is malingering. 
Don t you think you should yield to his 
opinion given all his experiences 1n the 
field of rehabilitation? 

- Are you aware of the concept of secondary 
gain? 

- Tell us the definition of secondary gain. 
Once again, we returned to vocational issues. 

- How do you know this man has no access to 
the labor market? Did you phone employers 
in town and try to place him? 

Can this man wash a car window? 
*^ Can this man measure oil in a «.ar? 
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Finally, we went to the ^'redirect," the 
opportunity for roy client's lawyer to ask me fi.Il 
the right questions to make up for any gaffs 
that I tnl g ht have mad e under croe s-examln atlon* 
l^aslcallyi he stayed to the Issue of what I was 
asked to do In the way of an assessment i and 
what medical restrictions I had considered. 
This gave lae the opportunity to offer that the 
aame doctor who suggested our client was 
r»allngering also assigned tha^parmanent 
disability ratina. Finally, be asked ^/^^at if 
society did not change, what were this man s 
chances for competitive employment. 

And so It was over. What seemed an 
eternity passed In approximately twenty-five 
minutes. My first trial had come and gone. Did 
I feel I was well-prepared? Generally. I wish 
I had not so firmly planted In my mind that 
short answers were best. Somehow. I took that 
too literally and. In retrospect, I feel I could 
have offered more Information without opening up 
the proverbial can of worms. Certainly, I had 
read enough literature on giving expert 
testimony that \ was not too surprised by the 
questioning. I was most grateful for the 
expertise of colleagues and their willingness to 
share experiences and practice with ^. 

Would I go through this all again? You 
bet. It was definitely an exciting, challenging 
experience. Most of the anxiety associated with 
being in court is not unlike the exam anxiety 
experienced by students and a healthy remedy foir 
both is an old motto that still rings true: be 
prepared. If you have done your homework, know 
all the details of your case and are confident 

In your findings^, putting .JP„. with the 

flhen£nigana in court is a lot easier. 
Good luckl 
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ABSTRACT 

Relmbilitatiou program development for persons 
with traumatic head injuries and cerebral 
vascular accidents is progressing at an 
impressivo rate. However, research 5;hows that 
current, rehabilitation prograBming is not 
keeping pace with the increasing needs of this 
special population. This paper reviews the 
' sequela often associated with clused head trauna 
and cerebral vascular accidents, and atteapts to 
provide some input as to why this population is 
difficult to rehabilitate. Various 
comprehensive teaii structures are identified 
with advantages and disadvantages reviewed. 
Vocational evaluation issues confronting the 
eyaluator as well as the evaluee are explored, 
with suggestions offered on how to resolve some 
of the evaluation problems. 



The terms '^Closed Head Injury" (CHI), "Brain 
Injured", and '^Traumatic Brain Injury" (TBI) are 
rehabilitation "buzz words" in today's market 
place. Head trauma rehabilitation is the newest 
focus of service development as more federal 
funding sources focus on this difficult 
rehabilitation population, and more hospitals 
develop inpatient and outpatient programs 
designed for head trau«a rehabilitation. The 
most recent statistical literature places TBI as 
the third ranking cause of death and disability 
under the age of 35 years old (Jacobs, 1988). 
Between 400,000 and 600,000 persons sustain head 
injuries annually, of which 100,000 die and 
between 50,000 and 100,000 survive with severe 
impairments that prevent independent living 
(Author, 1985; Corthell k Tooman, 1985; Jacobs, 
1988). An additional 200,000 head traumatized 
persons survive with continuing sequela that 
interferes with independent living skills 
(Jacobs, 1988), Further statistical review of 
annual medical and rehabilitation costs place 
the tab at 3.9 billion dollars (1980 dollars) 
yearly to accommodate and rehabilitate severely 
.. head injured persona, Given the high annual 
Injury rate and health care expenditures, 
Brotherton, Thomas, Hisotzek, and Milan (1988) 
noted that current rehabilitation research and 
practice have not kept pace and are insufficient 
to meet the needs of head trauma patients. 
Thus, this paper offers some insight into the 
development of an outpatient clinic model, its 
staff organization, and suggests how vocational 
evaluation should be integrated into the 
clinical system* 

Hood Trauma (!h/;^rftpl; >eriBtica 

Before proceeding to the clinical evaluation 
and treatment of traumatic brain injury, it is 
necessary to review the sequela which often 
accompanies traumatic brain injury, to include 
cerebral vascular accident (OVA), or stroke. It 
is important to review CVA sequela when 
referencing traumatic brain injury since TBI 
sequela are characteristic of CVA residuum, 
except more diffused (Anderson, 1981; Fralish, 
1988a; Muoante, 1983). Also, many hospital 
programs include CVA patients with TBI patients 
during rehabilitation programming, thus 
requiring clinical rehabilitation professionals 
to be knowledgeable in both types of head 
injuries. 

Stroke is considered i\ form of closed head 
trauma, defined as a sudden onset of weakness or 
other neurologic symptoms as a result of injury 
to a blood vesjjel in the brain (cerebrum, 
cerebellum, or brain stem) (Anderson, 1981). 
Causes of CVA .nay include thrombosis (blood 
clottiuR), hp.TDorrhage (blood veoeel rupture 
jje?ulting in bleeding in brain tissue) , damage 
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from pressure produced by blood leakage) and 
embolism (blockage of blood by clot in vessel) 
(Anderson, I98I). 

One rebabilitatlon advantage of CVA over TOI 
is the tendency for residual effects to be focal 
rather than diffused. Residual effects of CVA 
are specific to the affected brain hemisphere. 
For example! damage to the left cerebral 
hemisphere will result in communication 
(language - speaking, reading, writing) 
impairments as well as right side hemiplegia 
(Fowler, 1981; Musante, 1983). It is not 
uncommon to note auditory coiprehensiveness 
deficiencies an well. Right cerebral heaisphere 
damage will result in visual-spotial and 
judgment deficiencies. The key weakness of the 
right cerebral insult is the individual's 
inability to orient hiwelf or herself with 
respect to the environment. Thus, perceptual 
deficits are prevalent as well as visual-spatial 
deficits. Other deficiencies may include 
notor/aensory paralysis of the left side, depth 
p[reception, appreciation of the concept of 
wholeness froi incomplete fragmentary data, 
intuition, and critical imagination (Fowler, 
1981). 

Behavioral patterns differ between affected 
hemispheres. The individual with left 
hemisphere damage may respond in a slow, 
scattered, disorganised, and anxious fashion to 
new activity. Depression ib common since these 
people are usually over-sensitive to their 
disability. Persons with right aide damage uay 
completely deny any deficits; ignore, or be 
unawajre of them. Th^y are usually satis fied 
with their performance regardless of Its 
quality. Thus, right side damaged .persons ate' 

unable to learn from their mistakes or profit 
from experience. They are usually insensitive 
to the needs and desires of others, thus causing 
eventual rejection by their peers. 

Complications from CVA vary and are numerous. 
•Anderson (1981) listed depression, joint 
contractures, spasticity,' bowel arid bladder 
dysfunction, urinary tract infections, 
Dneumonia» seizures « subluxation of shoulder, ' 
and shoulder/hand syndrome. Fowler (1981) noted 
more general deficits resulting from CVA to 
include: 

1. Quality Control: Persons with CVA display 
a lack 0 ability in guiding and checking one's 
own behavior (doing the right thing at the right 
time). 

2. Memory: There is a tendency for 
information to be renembe.ed and processed 
selectively, whether it involves new Information 
or old information. The individual's retention 
span may have greatly decreased since the 
individual can no longer process high volumes of 
inrormation. Finally, the individual 
experiences difficulty with generalization, or 
Applying what has been learned in one setting to 
another setting. 

3. Emotional Liability: The individual may 
no longer be able to control his or her 
emotions. This involves laughing or crying 
without any apparent reason. 

In spite of the above residual affects 
resulting from CVA, there are two key 



factor which encourage rehabilitation: 1) 
Damage produced by stroke 1b not progressive; 
Improvement docs occur after the acute phast, 
and 2) the patient's adaptation to various 
disability components appears to improve over 
the long term (Anderson, I98I). 

Traumatic brain Injury (TBI) presents the 
rehabilitation team with a myriad of potential 
complications affecting cogtiltivc, 
psychological, behavioral, and physical 
functioning (Fralish, 1988; Frallah, 1988a). 
Unlike CVA etiology, TBI may be caused by either 
acceleration or deceleration forces acting on 
the brain. Specific types of lesions resulting 
from these forces '.nclude the following: 

1. Diffuse Lesions: Resulting from 
acceleration forces, these microscopic lesions 
are noted throughout the brain which usually 
causes permanent motor deficits consisting of 
paresis, slowness, ataxia, abnormal muscle tone, 
abnormal posturing, or any combination of the 
above deficits (Mills, 1988). Usually, an 
unconscious state follows diffuse lesions, with 
residual symptoms to include difficulty with 
maintaining optimum level of arousal, difficulty 
coming to, sustaining, or shifting attention, 
impaired vigilance, impaired gait and/or labored 
speech, fatigue, and reduction of mental speed 
and concentration (Corthell & Tooman, 1985). 

2. Concussive/Focal Lesions: Resulting from 
deceleration forces, contusions are noted at the 
frontal and temporal lobes resulting in memory 
deficits and executive functioning deficits 
(organisation and planning) . The individual 
usually has difficulty with initiating, carrying 
out, monitoring, and self correcting in 
goal-directed behavior. Additionally, the 
individual lacks the ability to generalized 
learned behaviors to alternate settings 
CCorthell i Tooman, 1985; Mills, 1988). 

3. Coup and Contrecoup Lesions: These result 
from the bending of the skull from a blow 
causing initial bruising, driving the brain 
against the opposite wall resulting in bruising 
on the far side (contrecoup). Resulting 
deficits include sensory, motor, perceptual, 
constructional, and language functioning 
(Corthell k Tooman, 1985). 

Traumatically brain injured persons are 
exposed to complications arly in their acute 
injury stage which may have an affect on their 
rehabilitation potential. Early medical and 
neurological complications were studied by 
Kalisky, Morrison, Meyers, and Van Laufen 
(1985). They reviewed medical charts of 180 
patients who were between one and six years post 
trauma. They determined ventricular dilation 
and poHttrauaatic seizures as the chief 
complaint (56% of files reviewed). 
Gastrointestinal problems w^th impaired liver 
function were noted in 50X of the files, 
followed by gastrourinary infections (^15%). 
Other complications included respiratory 
(tracheostomy complications), 
cardiovascular, and dermat^ logy (decubitus 
ulcers) . 

Secondary damage in Tin persona may result 
from bleeding between r.he akiill and brain 
(subdural hematoma) , within brain bleeding 
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(Intracerebral hematoma) , herniation of bralu 
matter due to excessive pressure from bleeding 
and swelling from fluid bulld-up, lower than 
normal blood oxygen (hypoxia), Inadequate blood 
supply to the brain (ischemia), abnormally low. 
blood pressure (hypotension) , and the formation 
of out-of-plaoe bone (heterotopic osslflc i:lon) 
(Corthell & Tooman, 1985; Mills, 1988), 

Residual deficits ImpactlnR rehabilitat-Ino 
progress and success may Include headaches, 
dizziness,, emotional stress and Irritability, 
depression, and anxiety, and an inability to 
attend to complex stiauli (Novack, Roth, & Boll, 
1988). Specific residuum are categorized under 
physical, cognitive, behavioral, and 
psychological functioning. Corthell and Tooian 
(1985) and Fralish (1988a) documented apecific 
functional losses under each of the above 
mentioned categories. They noted physical 
deficits to include spasticity of one or more 
extrepiities, gait impairments, wheelchair 
aaibulation training, sensory integration 
ittpai-FRent (i.e., impaired perception of 
teaperature, changes in tactile sensation, and 
difficulty with visual-notor integration), 
visual deficits resulting from luscle imbalance 
causing double vision and visual field 
restrictions, and Rotoric speech disorders 
(i.e., dyarthia and oral apraxia). Cognitive 
deficits reveal problems with 
attention/concentration such that the individual 
is unable to ignore external stimuli or unable 
to attend to task* Imniediate, short-term, and 
long-term lemory may be greatly coKpromised, and 
problea-solvlng capabilities are greatly 
reduced.. OrgaiilEational and planning are 
impaired such that task seauencing abilities are 
substandard. The patient often displays 
impaired categorization which affects one's - 
ability to generalize information to alternate 
settings or tasks* A common trait is the 
individual's rigidity, or inflexibility to 
explore alternatives to situations* They 
experience difficulty in etistalnlng internal 
mental activity for extended periods of time. 
Judgements and responae to their environment are 
usually Inadequate. Finally, there is usual Iv a 
processing spread, such that a delay in response 
to stiiuli is noted. This Bay also trigger 
impulsive or reactive behaviors. 

Behavioral changes are pronounced. 
Brotherton et al. (1988) noted that the 
traumatized individual usually is unable to 
engage in purposeful activity, uay be 
disinhibited, fails to initiate and Maintain 
conversation, or fails to respond to 
conversation of others. There say be 
inappropriate gestures (i.e., hand rubbing, 
biting nails, etc.), poor posture and eye 
contact, failure to reinforce statewents of 
others, and a focus on self and an 
affectively negative conversational content may 
be presonted. Fralish (1988a) added that the 
individual nay display inappropriate social 
skills and socially inappropriate behaviors. 
She further noted that there may be poor 
initiation and iwpulsivity displayed during 
Gvaluation/treatment activities. 

Psychological deficits may Include Bexual 
dieinhibitlon, temper outburts, and display or 



emotions (Corthell & Toonian, 1985). Fralish 
(1988) noted specific psychological patterns In 
the TBI patient. She listed these as follows: 

1. Impaired capacity for social 
percepTi'veness, characterized by self-centered 
behavior, decreased empathy, decreased 
self-reflection, and decreased ability to be 
self-critical. 

2. Impaired capacity for self control and 
self regulation, with" random restlessness, 
increased impulsivlty, and Increased impatience. 

3. Stiaulat ion-abound behavior resulting in 
social dependency, difficulty in planning and 
organizing, and decreased behavioral initiative. 

4. Eaotional changes including increased 
apathy, silliness, and irritability, emotional 
liability and increased or decreased sexual 
drive. 

5. Inability to profit from experience 
accompanied by decreased social learning. 

6. Conceptual and behavioral rigidity or 
inflexibility usually in conjunction with 
decreased self control or stimulus-bound 
behavior* 

7. Disruption of previous learnod social 
behaviors, including inappropriateness of 
context, frequency, duration, and sequence. 

8. Increased awareness of disabilities, often 
associated with depression characterized by 
withdrawal, sadness, inactivity, and 
self-destructive or agitated behavior. Anger 
■ay be characterized by irritability and 
bitterness. 

CAinical Program Structiiri> 

Therapeutic intervention requires a 
comprehensive team approach. No one 
professional group can profess to have the 
e)^pertise to address all of the known rejiduum 
of stroke and closed head injury. Team members 
aay vary in coaprehensive rehabilitation day 
program settings, with varying duties and 
responsibilities as well. Specific roles are 
assigned contingent on whether the tean is 
structured as nultidisciplinary, 
irterdisciplinary, or transdisciplinary . 

The day rehabilitation team should include a 
nedical director (Corthell & Tooaaan, 1985), 
neuropsychologist, speech therapist, 
occupational therapist, physical therapist, 
rehabilitation nurse, and a therapeutic 
recreational specialist (Moore k Plovnick, 
1G88). Ancillary team menbers may involve 
professionals from vocational evaluation and 
vocational rehabilitation (job placement). 
These Menbers are ancillary primarily due to 
funding constraints from third party benefit 
providers and medicare, which do not authorize 
payment for vocational services unless 
prearranged. However, in support of vocational 
rehabilitaticrM Moore and Plovnick (1988) noted 
that rehabUitation intervention should also 
provide for educational and vocational 
rehabilitation . as wel) as family, individual, 
and gtoup counseling. 
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Madical Director 
a physlatrlst by training, and directs the 
rehabilitation team. His or her primary role Is 
to provide infortnation regarding physical 
abilities and limitations » and predict how daily 
functioning will be affected* This individual 
is responsible for the final report with input 
from all disciplines involved (Corthell & 
Tooman, 1985) • 

H^uroDflycho lotf let * This individual assesses 
and treats brain behavior relationships, as well 
as provides guidelines for use of coMpensatory 
strategies for nenory problens* Additionally t 
this individual is a valuable resource to the 
tean regarding cognitive, executive, and 
behavioral/psychological deficits (Corthell & 
TooBan, 1985; Moore k Plovnick, 1988). 

Phy sical Therapist . This person specializes 
in the physical aspects of rehabilitation, and 
provides range of motion exercises and strength 
devel-opnent of the extremities. This individual 
also provides guidelines for ambulation, use of 
assistive devices, and transfers. Physical 
fitness programming may also be a recoonsibility 
depending on the degree of the patient's 
impairment (Anderson, 1981; Corthell & Tooman, 
1985; Moore k Plovnick, 1988). 

Speech/r n^.i^age Patholotfist . This person 
provides guidelines for the use of augmentive 
.communication devices, communication skills 
development, reading/writing skills development, 
and may instruct family in home techniques. The 
speech pathologist may also treat verbal memory 
deficits as well as address the role of language 
in organizing and planning functions (Anderson » 
1981). 

Occupmtionai Therapist . The occupational 
theraplat provides guidelines for adaptive 
equipment) assistance in activities of daily 
living and gross and fine motor skill 
development (Moore & Plovnick > 1988). This 
person f ocuhi^m th(\ fnnctinnal AAnAr.ts of 
rehabilitation, evaluating wid training in 
dressing, eating, and personal hygiene. The 
occupational therapist may evaluate a persons' 
driving skills, and take responsibility for 
improving the individual's attention, planning, 
and organizing functions (Anderson, 1981; 
Corthell & Tooman, 1985; Moore k Plovnick 
1988J. 

PsycholotfiBt . Although not typically a part 
of the team if a neuropsychologist is on staff. 
The psychologist can be invaluable in performing 
intellectual and personality assessments, as 
well as provide education and counbeling to the 
family. The psychologist may also instruct in 
the transfer of bcjhavior management and provide 
guidelines for social interactions as <^ell as 
intervention guidelines during times of atress 
and possible agitation (Corthell & Tooman, 1985; 
Moore k Plovnick, 1988). 

Rehabilitation Nurse . This individual 
provides nutritional and dietary guidelines 
assesses vitals periodically, and instructs in 



cc:lf administration ( f medication. The nurse 
provicdes the team with information regarding t\e 
patitnt^B alertness, and the patient's ability 
to care for find monitor him self or her self 
(Corthell & Tooman, 198S; Moore & Plovnick, 
1988) . 

Therapeutic Recreation Specialist . This 
person is responsible for guidelines regarding 
leisure skill development, use of community 
resources and participation in physical, social, 
and community activities (Moore & Plovnick, 
1988). 

Vocational Rehabilitation 
Counaelor/Evaluator . This person asBessea 
specific worker traits e*nd functional levels to 
determine the evaluee's maximum worker trait 
profile. This person also provide?: job 
placement assistance with supported 
and transitional employment resources, or 
selective placement as indicated. 

Team Structures 

Once the team members have been selected and 
approved, there is the decisi'^n regarding how to 
structure this team. Howard (1988) and Leland, 
i.ewis, Hinman, and Carrillo (1988) identified 
team structures as multidisciplinary , 
interdisciplinary, and transdisciplinary. 

Multidisciplinary Team 

Thle team approach requires indanenHpnt 
assessments from each respective member, listing 
each respective team member's program goals, 
objectives, and treatment plan designed to 
remediate deficits in a particular area of 
functioning (Leland et al., 1988). This model 
iQ referred to as a medical consultation model 
because of the emphasis on physician involvement 
and control. The physician usually makes the 
initial evaluation and obtains input from each 
team member before developing the treatment plan 
or writing the evaluation report. The physician 
leads the team staffings, and members ''report" 
to the physician. 

Howard (1988) noted deficiencies in this 
model which are summarized ab follows: 

1. Inadequacy of the medical model in 
general. Traumatize brain injured 
rehabilitation programs should be focused on a 
learning model based on skill acquisition. The 
rehabilitation process is one of assisting the 
patient with relearning necessary functions, 
such as aspects of self care and community 
re-integration. The medical model is concerned 
with procedures such as medicating, irradiating, 
or operating to alleviate a cure, and does not 
address skill attainment or re-development. 

2. Fragmentation. Consultations froa each 
rehabilitation discipline results in 
fragmentation in the overall planning of 
treatment and outcome goals. 

3. Lack of horizontal communication. 
Separate evaluations discourage the person from 
being viewed upon as a whole, but rather as a 
fragmentation of the total evaluation rrocesQ. 
Team members communicate among their respective 
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olleagues and the team leader, but rarely among 
other dlsclpllnea for evaluation feedback. 

4. Team leader as the decision maker. With 
the emphasis on separating the disciplines there 
is little encouragement of group interaction. 
Decisions regarding treatment plan, discharge 
plan, and family recommendations are left to the 
team leader, 

5) Focus is on intradisclplinary treatment 
goals. Treatment goals are often set without 
input froB other BeRbers. The result nay be an 
overlapping of treataent goalc and the 
evolvelment of territorial issues. 

InterdiHcin][^Tl,^f;Y T°nT 

This approach requires the blending of the 
various disciplines' skills and resources in 
order to provide effective rehabilitation. Team 
■enbers collaborate on the assessient and 
subsequent definition of outcome goals and n 
treataent plan (Leland et al. , 1988); The 
eaphasis is on group planning and px«oblen 
solving with the physician acting in a 
leadership capacity for the group process 
(Howard, 1988). However, Leland et al. (1988) 
noted that this approach lay also fragment the 
treatnent protocol since each teas neiber is 
responsible for only discipline-spe ific 
objectives, and works alone in evaluation and 
treatnent. 

TransdiHcii^^^nrirY T?fl1 

This approach requires the integr. cion of 
evaluation processes froB the respective 
disciplines, such that assessment information is 
synthesized into a single report (Leland et al., 
1988). Thus, the report reflects the 
collaborative developannt of outcoee goals, " 
provides a holistic picture of patient 
functioning, and identifies realistic outcone 
goals and objectives. 

— ^ approach is the ability and 

willingness of the dlsceiplines to collaborate on 
the samo treatment and evaluation milieu. For, 
example, the occupational and physical theia|)l|it 
■ay conduct their evaluations and treatment 
rerines as a teen rather than as 
separate entities. This enhances skill 
generalization because treatnent plan conponents 
are inplemented consistently by all teaa neebers 
across treatment settings. 

TrMBdlaclDlinarv f^ig ^ Pltfullii 

Although the transdisciplinary teaa looks 
good on paper, the practicality of such a aodel 
■ay be questionable. Scheduling problees are 
the BO re obvious setback, as tean aenbers' 
schedules will have to be coordinated with 
others, thus ainiwizing evaluation and treataent 
flexibility m such an unstable rehabilitation 
population. Secondly, staff neabers will be 
required to attend extensive inservice training, 
thus consuBing valuable billable and treatwent 
time. Thirdly, when utilizing various 
diBciplines in evaiuition and treatnent 
programs, territorial issues will surface, with 
one discipline clalning certain rights over the 
other collaborative team member in terms of 
evaluntlon and treatment protocol. Finally, the 



team would require a physician with a ralnd-set 
that would allow for equal collaborative; status 
rather- than a more "dlctatortal^' stRtii«- aa 
allowed In the multidisciplinary and 
intardiPclplinary approaches. Such physician 
types are rare. 

In actuality, multidisciplinary and 
interdisciplinary team approaches appear to be 
the preferred choice among rehabilitation 
facilities. With continued progress in the 
development of treatment strategies, the 
transdisciplinary teaa aodel nay be nore readily 
acceptable and practiced in the near future. 

Vocational gYftlyinfjyT, 

Vocational evaluation applied to head trauna 
rehabilitation addresses the influences of all 
deficits demonstrated by the traumatized person, 
and how these deficits iopact vocational 
functioning (McHahon & Frasier, 1988). The 
evaluation purpose is to assess the patient's 
aalleability (ability to react appropriately or 
adjust to changes, priorities, supervisors, and 
co-workers), retention of skills or potential 
for developaent through training, behavioral 
coapetence, and response to environaental 
stimuli which can greatly influence one's 
employability (Corthell & Toonan, 1985). 

SVftluation PreDar>t.i»n 

Prior to testing, the evaluator should be 
aware of certain personality factors and their 
prlglns so that test battery development will " 
include the most appropriate tests. Kor 
exaaple, understanding the patient's pre-onset 
factors (Lynch, 1982), and how priaary factors 
(factors directly related to the injury) and 
secondary factors (characteristics developed 
during the course of recovery) differ will 
better prepare the evaluator for potential 
behavioral issues regarding the evaluee's 
response to test activity challenges. This 
inforaation is usual, pr'^qented in team 
stttffings and through c. . note reviews. The 
vocational evaluator shot,, solicit family, 
treatment team, and client input before and 

.!:i"?u^*'^ evaluation. Results should be linked 
with those of the neuropsychological assessment 
findings with frequent feedback and 
consultations with the neuropsychologist, and 
the evaluator should expect inconsistent 
performances across tests with occasional 
manifestations of anger and frustration (McMahon 
4 Frasier, 1988). Thus, with detailed 
preparation and ongoing input from team and 
family mer'-ers, the vocational evaluator will 
have to re, in alert and ready for unpredictable 

Vpcfttional Ev^j^^t.^^^^ Tg 

Thtf THI patient ic a difficult person to 
evaluate vocationally, and the evaluator should 
bo aware of certain issues which nay 
significantly influence the total e/aluation 
process and outcomes. 

Muaante (1983) identified inconsistent 
pe.-formance, patient reaction to tiuks, use of 
standardiied worksamples, snd the typlral 
non-fltatic approach in evaluation delivery as 
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concerns Tor the evaluator. These are described 
in more detail below. 

Perfonaance Inconal8tenclea » Performances 
may vary among patients due to certain Toemory 
deficits. For example, the Individual may be 
able to retain old memory, thus presenting him 
or herself to be fairly co^nizaru of events 
HoweyiEtr, new' memory may be greatly compromised, 
thus preventing the individual from following 
through with seemingly simple sequenced testlv.g 
activities. The evaluator lay underestimate the 
patient's abilities and offer a teit which 
proves to be too coaplex. One solution is to 
offer the individual tests which require 
pr&ctice trials which are included in 
the normative process for that respective test. 
This will enable the evaluator to test-out any 
ahort-tera or ii^medlate recall deficits. 

Expression ftf Antfer/Prustration . Once simple 
tasks way now be difficult and complex for the 
individual. It is important for the evaluator 
to understand that although the individual may 
present a different level of cognition, that 
individual is very aware of the residual changes 
presented by the disability and what he or she 
was once able to do. The evaluator is 
encouraged to graduate initial activities to 
more complex activities after baseline 
functioning has been estnblished through trials. 
This will allow the evaluee to experience the 
satisfaction of task completion and success. It 
is important that the evaluator provide 
immediate feedback and support for taaks 
completed' successfully . 

gf ^l indardiTed Workaamp]! .? Ad"^»^«^ratiQn. The 

individual may not be able to perform the te&ts 
due to dysfunction in upper extremity, thus 
requiring test modifications. For example, 
persons with perceptual and language deficits 
may require instructions.to be pantomimed or 
demonstrated rather than verbally presented, cfr 
pictures displaying tasks sequences be offered 
in the place of verbal instructions. The 
evaluator is also encouraged to offei 
instruments which encourage learning of 
activities. For example, the Valpar Tri-Level 
Measurement Teat requires the learning of 
various measurement processes through activity 
sequencing. Two other tests which have been 
researched in head trauma vocational evaluation 
that report excellent learning and sequencing 
requirements are the Differential Aptitude Testa 
and the MacQuarrie Test for Mechanical Ability 
(Lezak, 1983). 

Non-Static yvaltiat.^Qn Approach. The 
vocational evaluation process in TBI settings 
needs to be more flexible, and not as rigid in 
terms of testing protocol. For example, the 
evaluator should have the ftvaluee demonstrate 
the skill which is being evaluated before 
engaging in the formal test activity. If 
reading skills or comprehension are questioned, 
the evaluator should have the evaluee read the 
test instructions back to him or her. Test 
instructions should be presented in short and 
concise components, bo as not to confuse the 



individual. The. evaluator raus. remember to 
provide the evaluee a good explanation of the 
tests and their purpose, and to repeat this 
explanation fvom tast to test* 

Sunmary and Conclusions 

DlBablllty resulting froir cerebral vascular 
accident or traumatic brain Injury presents a 
challenge to the rehabilitation profession. The 
etloloK^ of CVA and TBI alone constitutes a need 
for team involvement and special programming for 
rehabilitation facilities accepting closed he\d 
injured persons. The current movement in 
rehabilitation towards resolving head trauma 
deficitF has not been able to keep pace with the 
needs of this special population. Thus, heewi 
trauma rehabilitation programs are enjoying 
growth and receptivity in federal and private 
insurance benefit programs. 

Resolution strategies of head trauma residuum 
require a comprehensive team effort in which 
various professional disciplines are 
represented. Whether the team is structured as 
multidisciplinary, interdisciplinary, or 
transdiaciplinary rests with the medical 
directors and hospital/facility administrators, 
who depend on medical coverage from physical 
medicine and rehabilitation specialists. 
Further research and data analysis of team 
efficiency is needed before valid conclusions 
can be assimilated. 

Vocational evaluation of this special 
population is difficult due to the 
manifestations of head trauma residuum. 
Evaluators encountering closed head injured and 
stroke patients will need additional training to 
effectively apply test results for interpretive 
purposes. Particular areas of training should 
include addressing the various behaviorrl 
responses to activity typifiea in head injury 
disabilities. 

References 

Anderson, T.P. (1981). Stroke and cerebral 
trauma: Medical aspects. In W. Stolov k M. 
Glowers (Eds.), H andbook of i»^vfire diaahility 
(pp. 119-126). Haobington, D.C.: U.S. 
Government Printing Office. 

Author (1985). Traumatic Head In.lury; A r ^gQUm 

ftm^ i l ^Q'' vocat j^riftl r'^Vft*?Uit-fr^^Q'^ - ^^^^ 

theory to practice . Vocational Rehabilitation 
Center of Allegheny County, Inc., 1323 Forbes 
Avenue, Pittsburgh, Pennsylvania. 

Brotherton, F. , Thomas, L. , Wisotzek, I., k 
Milan, M. (1988). Social skills training in 
the rehabilitation of patients with closed 
head injury. Archives of physical Medicine 
und Rehabilitation . fiSdO), 827-832. 

Corthell, D. , i Tooman, M. (1985). 

Rehabilitation of trau^ft tiic brfeiD--il?iur^ » 
(Twelfth Institute on Rehabilitation Issues). 
Researoh and Training Center, University of 
Wisconsin-Stout, Stout Vocational 
Rehabilitation institute, Menomonie, 
Wisconsin. 



NATIONAL FO^^UM 



151 



Fowler, R. (1981) • Stroke and cerebral trauma. 
In W. Stolov & Glowers (Eds.), Handbook of 
.severe dleabllltx (pp> 127-135). wTHhingtonr 
D.C.: U.S. Government Printing Office. 

Fralieh, K. (1988). Characteristics of persons 
with head injury. In P. Deutsch & K. Fralish 
CSds.), Innovations in head iaiurv 
rehabilitation fpp. I/I-1/15) / New York: 
Mathew Bender, Co. 

Fralish. K. (1988a). Closed head trauia in the 
adult and older child. In P. Deutsch and H. 

oVirL^^AV^* A g^ide to rf.h^HH«;ilti?M (pp. 
23/1-23/47). New York: Mathew Bender, Co. 

Howard, M.E. (1Q88). interdisciplinary team 
treatment in acute care. In P. Deutsch & K. 
Fralish (Eds.), Innovation s in hea^ j jn.ivr Y 
rehftbUitftt^Qn (pp. 3/1-3/26). New York: 
Mathew Bender, Co. 

uacoba, H. (1988). The Los Angeles head injury 
survey: Procedures and initial findings. 
Archives of Phvaj cal Medicine ahH 
Betia^)iUtaUQn, M(6), 425-431. 

Kalisky, Z., Morrison, D. , Meyers, C. , L Van 
Laufen, A. (1985). Medical problems 
encountered during rehabilitation in patients 
with head injury. Archives of phvaiff i ^^ 
Wedj^in? and Rehabilitation , ££(1), 25-29. 

Leland, M. , Lewia, F., Hinman, S., & Carrillo, 
R. (1988), Functional retraining of 
traumaticaliy brain injured adults* in'* a' 
transdisciplinary environment. Rehabilitatio n 
C ounseling Bulletin . 31.(^)» 289-297; ^ 

Lezak, M. (1983). KeuroPBycho^otfical aA»e»^p.nnf 
New York: Oxford University Press. 

Lynch, W. (1982), Emotional consequences of 
brain injury. In Trexler (ed.). Cognitive 
Rehabilitation; Conceptualization and 
intervention (pp. 63-76^. N.^t^ Vnri.t pienmn 
Press. 



Novack, T., Rotih, D., & Boll, T. (1988). 
Treatment Alternatives following mild head 
injury. Rehabilitation Counseling Bulletin. 
31(4), 313-324. ^ ' 



McMahon, B. , k Prasier, R. (1988). Vocational 
Rehabilitation. In P. Deutsch k K. 
Fralish (Eds.), Innovations in head ini vr^ 
rehaSiiiitfttifin (pp. 12/1-12/37). New York: 
Mathew Bender, Co. 

Moore, K., & Plovnick, N. (1988). Post -acute 
prograiBB. In P. Deutsch & K. Fralish (Eds.), 

■IPTOvftUyni ? in kftd in ,iAjU!£,i:sliiik^^ (pp. 

5/1-5/53). New York: Ma" hew Bender. Co. 

Mills, V. (1988). Physical rehabilitation. In P. 
Deutsch II K. Fralish (Eds,), Innovations j jp 
head in.iury reyt^i n f^f inr^ (pp. 9/1-9/25). New 
York: Mathew Bender, Co. 

Muaante, S. (1983). Issues relevant to the 
vocational evaluation of the traumaticaliy 
head injured client. Voj^atiojiaO 
and Work Adjustaent Bu^j^Hn, i&(2), 45-49. 



NATIONAL FORUM 



153 



EFFECTS OF UVEL OF ACCULTURATION AND ACCEPTANCE OF DKARTITTv 
ON VOCATIONAL EVALUATION AMONG INDIVIDUALS 6fmExI^ 

JULIE F. SMART, Ph.D. 
JULIET H. FRIED, Ed.D. 
GARTH M. ELDREDGE, Ph.D. 



Abstract 

It is thought that Mexican Americans 
experience low application rates for 
rehabilitation services. In addition, it is 
known that Mexican Americans demonstrate 
widely varying degrees of acculturation to 
Anglo American world views and values. There 
has been much speculation '^among 
rehabilitation p>*act1t1oners concerning the 
role that the Mexican American culture plays 
in acceptance of the disability by the 
Individual with a physical impairment. Three 
efforts in mental health counseling have 
shown that the provision of more culturally 
relevant and sensitive services was 
associated with greater use rates among 
Mexican Americans. Up until recently, there 
were no studies in rehabilitation that 
attempted to empirically demonstrate this 
relationship, but it was reasonably assumed 
that the provision of more culturally 
sensitive and relevant rehabilitation 
services would result in higher Mexican 
American application rates. The purpose of 
this paper is to present information related 
to a recent study which researched the 
effects of level of acculturation and 
acceptance of disability in the utilization 
of rehabilitation services among individuals 
of Mexican American origin. It Is believed 
that vocational evaluators who have access to 
this information might approach vocational 
assessment and evaluation from a different 
perspective. 



Introduction 

One of the philosophical assumptions of 
public rehabiTitation is that of equal access 
to services for all Americans. In contrast 
to this, research has shown that all 
minorities, including Mexican Americans, tend 
to underutilize rehabilitation services 
(Lafitte, 1983; Linsky, Arnold & Hancock, 
1983; Rivera & Cespedes, 1983; Suazo, 1986). 
Thinking only in terms of workforce 
utilization, it is apparent that a vast 
American potential is being wasted. 

Any service must be presented to Its 
constituency in a manner which will allow the 
'tonstituents both the awareness of services 
available and the motivation to utilize the 
services. Rehabilitation is no exception. 

Public rehabilitation consists of a 
system of knowledge, beliefs, norms, values, 
attitudes, techniques and procedures. Thus, 
rehabilitation services are part of the 
dominant culture and are, to a great extent, 
determined by Anglo American world view and 
values. One set of cultural beliefs may 
determine the way in which services are 
provided while differing, and perhaps 
conflicting, s< ts of cultural beliefs of 
potential clients may influence how these 
services are utilized. 

Central to the rehabilitation process is 
the disabled individual's reaction and 
adaptation to his or her disability. It is 
known that Individuals differ in their 
reactions to disabilities (Dembo, Leviton i 
Wright, 1956; Dohrenwend & Dohrewend, 1969, 
1974; Linkowski, 1971, 1987; Safilios- 
Rothchild, 1970; Woodrich, 1982; Wright, 
i960). In addition, the degree of acceptance 
ci disability may influence the individual in 
his or her decision to apply for services and 
subsequently enhance or retard the success of 
the entire rehabilitation process. Linkowski 
(1987) states: "Acceptance of disability is 
assumed to be an important ^mediating' 
variable. It can assist researchers and 
practitioners in understanding the connection 
between the person's disability and self- 
perception and, further, in predicting 
independent living, educational, and 
vocational rehabilitation program-related 
outcome:^" (p. 1). 

It is safe to assume that attitudes and 
perceptions of the Mexican American toward 
his or her disability are determined to some 
extent by the Mexican American culture 
(Chacon, 1981; Harward, 1969; Rivera, 1973; 
Sf rt, 1988; Turnball & Turnball , 1987; 
Zayas, J981). Arnold (1987) concludes: 
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Cultural elements such as language, 
family roles, sex roles and beliefs and 
acculturative stress can play a 
significant role in the etiology, 
symptom manifestation, and 
rehabilitation treatment of 
disabilities. Culture can influence (a) 
the beliefs about causation, (b) the 
conditions that qualify as "sickness,' 
(c) the expectations about what the 
affected person should do, and (d) the 
expected actions of others In response 
to that person's condition (Mumford, 
1981), Essentially, It Is believed that 
when sociocultural elements are Included 
^n the assessment and rehabilitation 
process, clients will be more accurately 
evaluated and effectively rehabilitated 
than when these elements are excluded, 
(p. 15) 

Acceptance of disability may influence 
application rates, drop-out rates, and 
successful closure rates. Level of 
acculturation may affect not only 
application, drop-out, and success rates, but 
also acceptance of disability, desire for an 
ethnically similar rehabilitation counselor, 
and other factors deemed critical for 
rehabilitation success. 

While there are no studies reported in 
the rehabilitation literature that . 
investigate the relationship between 
provision of culturally relevant services and 
application rates, there have been such 
studies reported in the mental health 
counseling literature. Burruel and Chavez 
(1974), Morales (1978), and Ponterotto (1987) 
view the underuse of mental health counseling 
services by Mexican Americans as the 
consequence of the culturally irrelevant 
services offered by monocultural Anglo 
American counselors. Ponterotto concludes: 
"It follows, then. If counseling services 
were more culturally sensitive and relevant, 
rates of use would Increase" (p. 308). 
Indeed, three efforts (Laosa, Burstein, & 
Martin, 1975; Martinez, 1977; and Morales, 
1978) to provide more culturally relevant 
services to Mexican Americans did produce 
Increased rates of use. 

It Is reasonable to assume that the same 
relationship between provision of culturally 
relevant services and application rate would 
be found In rehabilitation. Moreover, in 
rehabilitation, such culturally relevant 
services would Include an understanding of 
the individual's perception and accepL:ince of 
his/her disability. 

The Problem 

Considering the number of Mexican 
Americans In the United States and the low 
utilization rate of rehabilitation services 
by this population, further investigation 
into the role of culture and acculturation 
and its effect on acceptance of disability is 
therefore warranted. If a deeper 
understanding of the Mexican American culture 



and its impact on each disabled Mexican 
American could be obtained, culturally 
relevant rehabilitation services could be 
extended and, hopefully, utilized. This is a 
relationship that needs to be clarified. 

To date, there has been only one study 
which attempted to provide empirical evidence 
concerning the relationship between the 
Mexican American Individual's level of 
acculturation to Anglo American values and 
his/her acceptance of disability (Smart, 
1988). This paper will present the results 
and background information related to this 
research and Its application to vocational 
evaluation service delivery. It is believed 
that vocational evaluators who are aware of 
this information will be able to provide more 
culturally relevant and sensitive services. 

Demographics 

Once considered a small minority, 
Hispanics In the United States are increasing 
In number and also emerging as a political 
and social force. Many demographers predict 
that by the advent of the twenty-first 
century, Hispanics will be the largest 
minority In the United States. Indeed, In 
the southwestern United States they already 
a^'e the largest minority. Mexican Americans 
comprise sixty percent of the Hispanic 
population, thus forming the major 
contingent. Schrelber and Homiak (1981) make 
this observation concerning the population 
growth of Mexican Americans: "ho other 
ethnic group distinguished by the United 
States census has as high a fertility rate as 
Mexican Americans" (p. 270). 

In summarizing the soclodemographic 
characteristics of Mexican Americans, It Is 
apparent that many Mexican Americans 
experience a cluster of problem; Including 
low Income, lack o^ educatlcr^, tinployment In 
physically demanding and dangerous jobs, 
unemployment, poor health, poor health care 
utilization, and lack of Insurance coverage 
^Angel, 1985; Angel & Cleary, 1984; Bean, 
Stephen, & Opitz, 1985; Castillo, 1983j 
Dicker & Dicker, 1982; Dixon & Bridges, 1979; 
Gann i Dulgan, 1986; Garcia, 1984; McLemore & 
Romo, 1985; Moustafa & Weiss, 1968; Schrelber 
i Homiak, 1981; Suazo, 1986). Thus, there is 
a great noed for rehabilitation services and 
yet, at tie same time, there is an 
underutilization cf such services. 

Acculturation 

In order to provide culcurally relevant 
rehabilitation services, some judgment or 
measurement of acculturation must be made. 
Differing, sometimes conflicting, definitions 
have been utilized These have included such 
diverse variables as generational level, 
language usage, attitudinal and cultural 
preference (Ortiz i Arce, 1984; Szapocznik & 
Kurtlnes, 1980) and socioeconomic mobility 
(Grebler, Moore & Guzman, 1970). 

Nonetheless, judgments of acculturation 
were often made on the basis ^f a single 
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variable, most often language spoken. 
Moreover, such judgments were often 
subjective, meaning that a single individudl 
made the judgment, often In a highly 
informal, unidimensional , and qualitative 
manner. 

With the advent of sophisticated, 
multidimensional acculturation ins;;ruments, 
it is now possible to more accurately, 
objectively, and quantitatively r^easure an 
Individual's level of acculturation, 
employing behavioral, demographic, and 
psychological variables. 

Arnold (1987) asserts that the construct 
of acculturation, like the construct of 
intelligence, will eventually come to be 
defined as it is measured. He has observed 
that at one time Intelligence was a concept 
of much debate. The concept of intelligence 
has evolved to the point where it is often 
viewed as **what Intelligence tests measure". 
Furthermore, intelligence tests are widely 
used as an important assessment tool. 
Likewise, the concept of acculturation. In 
his view, will evolve to the point where it 
will be operationally defined by the 
procedures which measure the construct. Such 
measures of acculturation will become 
important assessment techniques. 

Level of acculturation of Mexican 
Americans with physical disabilities may 
impact the rate of application for 
rehabilitation services, the drop-out rates 
of those declared eligible for services, and 
also the number of successfully rehabilitated 
closures. 

Acceotance of Disability Among Mexican 
Americans 

There has been much discussion 
concerning the acceptance of disability among 
Hispanics and Mexican Americans. There are 
many who posit a difference between Anglo 
Americans and Mexican Americans in the 
acceptance of disability. Thus, differing 
levels of acculturation among Mexican 
Americans to Anglo American values might be 
associated with differing levels of 
acceptance of disability. However, there are 
no empirical studies to support this 
hypothesis. 

Five factors may be associatec! with 
acceptance oi disability among Hispanics and 
Mexican Americans. These are: 1) well 
defined sex roles, 2) a stoic attitude toward 
life in general, 3) a familistic, cohesive, 
protective society, 4) religious views, and 
5) reliance on physical labor. Obviously, 
there is a great deal of ambiguity and 
disagreement among researchers as to the 
definition of each of these factors and the 
role they play in the acceptance of 
disability. Each of these will be britfly 
discussed below. 

Well defined sex roles . Rivera (1983) 
and Schreiber and Homiak (1981) observed a 
relationship between the well defined sex 
roles of men and women in the Mexican 
American culture and the acceptance of 



disability. Many Hispanic men h:ve been 
taught that it is their responsibility to 
provide all the resources for the family. 
Women are to be homemakers. Rivera stated: 
"The experience of a disabling condition may 
have a greater impact on an Hispanic male's 
self image than it would on persons who 
perceive themselves in their roles less 
stringently" (p, 65). 

Stoic attitude toward life in general . 
Clark (1959), Harward (1969), and Saunders 
(1954) found stoic attitudes toward life in 
general and an attitude of resignation, 
acceptance, and "nothing can be done" toward 
health problems and disabilities. Problems 
should be borne with courage and dignity. 
Harward reported: "The lower class Mexican 
American in times of stress and misfortune 
tended to view difficulties as part of the 
life package which fate had r^ecreed. There 
was less inclination to question or berate 
than among Anglo Americans" (p. 8). 

Familistic. cohesive, protective 
society . Rivera (1983) and Rivera and 
Cespedes (1983) declared that the Mexican 
American family plays a very important role 
in the rehabilitation outcome. Collier 
(1983), Cruz (1979), Rivera (1983), Schreiber 
and Homiak (1981), Turnball and Turnball 
(1987), and Zayas (1981) characterized the 
reaction to disability of the tightly-knit, 
family-oriented Hispanic culture as that of 
providing support and comfort at home. Cruz 
(1979) made this statement: "Hispanic 
families tend to overprotect and paternal ize 
their disabled. Even if a disabled 
individual wants to learn to be independent 
and self sufficient, he Is seldom allowed to 
do so" (p. 33). 

Religious views. Baca (1974), Cruz 
(1979), Schreiber and Homiak (1981), and 
Zayas (1981) all point to ',he role that 
religion plays in the definition, response, 
and acceptance of disability. Many 
disabilities are viewed as having a 
theological etiology. Cruz (1979) stated: 
"In many areas superstitions persist that 
disability is a punishment for some unnamed 
wrong" (p. 33). Lafitte (1983) makes this 
statement: 

The reaction to a physical or 
mental disability varies in different 
cultural environments. In the Hispanic 
milieu, i disability is often seen as 
divine punishment for one's sin--usually 
the sins of the p^.^ents of the disabled 
individual. This is an area where the 
specific subcultural characteristics of 
the Hispanic client are of paramount 
importance to the counselor in order to 
understand and identify the individual 
pattern of the client and help him reach 
higher levels of adjustment, (p. 54) 

Beli^ngg upon physi^Al_Labfi£> It has 
been shown that Hispanics are overrepresented 
in physically demanding jobs which have a 
high risk of illness, disability, and 
fatality. Hispanics also have lower levels 
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of education. For any individual with a 
disability, the resources that he or she has 
and the number of options open to him ^ her 
will probably influence the acceptance of 
disability. Those individuals with few 
resources, such as employment opportunities 
and training options, might accept disability 
differently than those who have a great 
number of opportunities and options open to 
them. For those Hispanic and Mexican 
American individuals who have earned their 
llvl.q by physical labor and have little 
proficiency in English, a physical disability 
may preclude many employment and training 
opportunities. Indeed, the disability may 
represent more than a physical loss. Zayas 
(1981) reported: "You have to remember that 
Hispanic men, in a great many cases are 
laborers. What t\ese men are trying to do is 
regain the attributes they had before the 
disability. . . They have lost the status 
that they had." 

Thus, it can be seen that the review of 
the literature relating to these five 
variables strongly suggests marked 
differences between Mexican Americans and 
Anglo Americans. 

The Research 

In the study which attempted to 
understand the relationship between 
acculturation and acceptance of disability. 
Smart (1988) complied with Ibrahim and 
Arredondo's (1986) recommendations for 
ethical standards in cross cultural research. 
Likewise, guidelines offered by Padilla and 
Lindholm (1984) were incorporated 'into the 
design and methodology c* this project. 
These included: 1) The use of bilingual, 
bicultural rehabilitation cou.>selors who are 
also members of the community as data 
gatherers. It is thought that more valid 
responses can be obtained from an ethnically 
similar data gatherer. Furthermore, if the 
subject Is not literate In either Spanish or 
English, items of the instrument may be read 
to the subject In Spanish or English, or a 
combination of the two languages. 2) The use 
of a intra-group study. Only Mexican 
Americans were included as subjects. No 
comparisons were made to any other ethnic or 
cultural group. Thus, this design is 
responsive to the criticism raised by 
Hispanics that the dominant, or the Anglo 
American, culture is often used as a 
definitive standard of evaluation. No such 
comparisons were made in this study. 3) The 
provision of instruments in both Spanish and 
English. Thus, monolingual Spanish-speakers 
may be included in this study. Subjects may 
elect to use the language in which they feel 
most proficient. 4) The careful definition 
of the group being studied. In the past, 
researchers have not studied the various 
subcultures of the Hispanic culture 
separately. Since these subcultures vary 
greatly, many important differences have been 
overlooked and interpretations of results are 
of questionable value. In the present study. 



boly Mexican Americans were included. In 
addition, criticism has been leveled at the 
various iriethods used to define the population 
under stuiy. In the present study, only 
self-identified Mexican Americans were 
included. Thus, a consistent effort was made 
to adhere to both sound research methods and 
high ethical standards of cross cultural 
issues. 

Twenty-nine Mexican American clients or 
former clients with physical disabilities 
from two Colorado Division of Rehabilitation 
district offices served as subjects. 
Subjects completed four instruments. Two 
instruments measured acculturation to Anglo 
American values. These were the 
Acculturation Scale fo r Mexican Americans and 
the A??^0t M^qtl9" Classification System . The 
third instrument was the Acceptance of 
DisabiHtv Scale which produced an objective, 
qualified assessment of the individual's 
adjustment to and acceptance of his or her 
disability. The final instrument, the 
Biographical Information Questionnaire ^ was 
constructed specifically for the study and 
elicited biographical information and data 
concerning the client's experience with the 
Division of Rehabilitation. No relationship 
was found between acceptance of disability 
and level of acculturation. One possible 
explanation why this study found no 
relationship between these two variables may 
lie in the fact that the Individuals included 
in the study had attained relatively high 
educational levels. Fifty-five percent were 
college educated'. 

Smart's (1988) study stands as a 
preliminary approach to understanding the 
relationship between acculturation and 
acceptance of disability. Because the sample 
was biased by overrepresentation of highly 
educated subjects, there is need to go beyond 
such a narrow sample. In particular, there 
appears to be a need to sample Mexican 
American migrant workers who would represent 
a different socioeconomic and educational 
level. In addition, interview data to be 
gathered in future studies could add th^ 
deeper dimension of the Mexican American 
subjects' desc>"iption of their personal 
acculturation process, their reaction to 
disability, and their experience in the 
rehabilitation program. Finally, the 
relationship of the two variables of 
acceptance of disability and level of 
acculturation to rehabilitation success needs 
to be further investigated. 

A p plication to Vocational Evaluation 

The preceding discussion highlights 
issues related to acculturation and 
acceptance of disability among Mexican 
Americans involved in rehabilitation service 
delivery. Obviously, these same issues have 
direct application to the provision of 
vocational assessment and evaluation 
services. Level of acculturation impacts the 
individual's view of work and of life, in 
general. Likewise, acceptance of one's 
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disability determines how the individual 
perceives work and responds to vocational 
evaluation and the overall rehabilitation 
process. If the client's perception of work 
IS altered, it will affect how the 
rehabilitation professional provides 
services. An awareness of cultural 
differences and their importance in 
determining the individual's attitudes and 
behaviors cannot be emphasized enough. The 
rehabilitation professional, when working 
witn a Mexican American client, is faced with 
the task of distinguishing what is 
universally human,' what is culturally 
specific, and finally, what is idiosyncratic 
(de la Cancela, 1985). The rehabilitationist 
must be careful not to assume thai his or hei- 
culturally-bound experience is an adequate 
guide to what is universally human. 
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ECOLOGICAL ASSESSMENT OF INDIVIDUALS Fr.nt^ DIFFERENT CULTURES: THE 
IMPACT UPON VOCATIONAL EV'ALUATION 



NORMA L. COLVER 
FRANCES Q. SMITH 



Abttract 

In r»c»nt yvr.ri, vocational ai«»i«m»nt 
s»rvic»i hav* sMpanded to include a 
groatsr nurnbur oi limited Engliih or non- 
Engliih ipsaking perions from div»rs» 
cultural background!. Thii trend i% 
•xpsctsd to continue into thm future, 
ffBpecially in urban areas, du» to th» 
growth oi minority populations as wsll as 
recent Ivgislativs mandates. Ths 
proportion oi High School dropouts is 
often larger in groups such as Hispanic 
and American Indian populations. 
Likewise, adults from minority groups are 
generally underachieving in employment 
settings and remaining at entry-level 
positions. In a hierarchy of 

interventions, vocational assessment is 
of utmost importance because it can work 
as a facilitator to highlight vocational 
strengths. In addition, it can Increase 
the chance for these individuals to 
access the needed support and 
transitional services. Mhen assessing 
individuals from different cultures, it. 
is important that language skills and 
cultural backgrounds are considered 
during the process* Culture affects an 
individual's approach to learning* 
Therefore, the evaluator should consider 
learning style as influenced by culture, 
social interactions that are dictated by 
the value system, and background 
environmental Influences. Current 
evaluation tools are based on information 
from the U.S. Department of Labor as well 
as customs as they pertain to the 
technology and value system. Although 
these tools determine strengths and 
aptitudkis of the individual, it is the 
more subtle factors which can be 
culturally binding which often have 
impact upon assessment results* It is 
imperative that the evaluator ascertain 
the individual's cultural environment. 
This can best be accomplished at the 
onset of evaluation through conducting a 
comprehensive interview of ecological 
factors • 



In recent years, there has been an 
influx of immigrants into the United 
States. These people bring with them 
values, customs, beliefs and a unique set 
of personal experiences by which they 
interpret the social environment. When 
these individuals eeek employment or 
training they are faced with the American 
work ethic which requires specific norms 
of behavior. These required behaviors may 
be in direct contradiction with theirs.' 
This cul tural ly determined expectation 
may further complicate their adjustment. 
Those values which they had accepted as 
truth and which were the accepted 
behavior in their former culture are 
suddenly no longer valid, and the 
individual experiences rul ture shock , a 
pervasive sense of helplessness whic^ ma^ 
lead to stress , depression , anger , and 
frustration (Adler, 1986) . Culture shock 
could be compared to the onset of sudden 
disability. 

The influx of immigration during the 
past two decades is the third wave of 
immigrants in the history of the United' 
States. The first lasted from 1640 to; 
1860 and came mainly from Northern 
Europe. The second from 1880 to 1920 
came mainly from Southern and Eastern 
Europe. The latest wave comes from other 
parts of the world. In 1980, Immigrants 
came from 194 nations (Allen, 1989). 

According to Muller and Espenshade 
(1989), 34X of the new immigrants have 
come from Asia, 347. from Latin America, 
16"/. from Europe and 16'/. from other 
continents. These Individuals tend to 
settle in larger urban areas where they 
are likely to find support systems, such 
as other family members, similar cultural 
groups and Job opportunities. As noted 
by Kellogg, 40V. of the immigrants counted 
in the 1980 Census live in Los Angeles 
and New York and another 20*/. live in San 
Francisco, Ch. cago, Miami , Houston and 
Washington, D.C. In fact each of these 
cities was noted among the top 10 
metropolitan areas where immigrants chose 
to live (Kellogg, 1968). 

We don't know yet what the impact 
of the 1986 Immigration Ref rm and, 
Control Act will be. However, It is' 
anticipated that societal institutions 
wi 1 1 soon shoulder the burden of 
providin'i services to these populations. 
As a step in the hierarchy of hur.art 
resource services, vocational assessment 
plays an essential part. 

Statistics show that a significantly 
1 arger percentage of documented 
immigrants are between ages 16 and 24 
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(MuUer and Eapen»hade). This increase 
may bv influ»nc»d by the fact that 
f ami lien from war torn countries bring 
the orphaned children r-f their relatives. 
It ia estimated that undocumented 
immigrants have an even younger average 
age (Kellogg, 1988). 

Public schools are beginning to feel 
the impact cf this influx and the strain 
which this places upon available* 
resources. Accordif»g to Kellogg, minority 
levels now range from 70-967. in the 
nation's 15 largest schools (Kellogg^ 
1988). Additionally, legislative mandates 
provide assurances that the needs of 
these individuals must be met according 
to their unique cultural and linguistic 
needs <The Carl D. Perkins Vocational 
Education Act, P.L. 98-524). 

Individuf ^ differences 

People's vocational perspective 
reflects their past experience. These 
factors are important to consider in the 
vocational assessment process as these 
persons may not only be affected by their 
culture but also by their individual 
personal experienco. Likewise, these 
factors are important when establishing 
the climate for conducting the initial 
interview. The fact that individuals 
belong to a specific ethnic group does 
Inot always imply that they share the same 
background experiences. Beliefs, values, 
attitudes and degree of language 
knowledge, as well as fducation, may vary 
considerably from one individual to 
another . 

Awareness of individual differences 

is crucial in vocational 
evaluation/assessment. According to 

•Sattler (1962), factors which could 
influence an assessment situation are the 
individual's values, styles, motivation, 
language, mores and attitudes. In order 
to conduct a non-biased ^ssessm^-jt , the 
evaluator must take these factors into 
consideration. 

Vocational evaluation /assessment is 
in a unique position to accommodate the 
individual needs of individuals from 
different cultural groups. Culturally 
and linguistically different individuals 
do not perform well on paper and pencil 
tests. Often, they h^ve been alienated 
by academic-related activities, or they 
may be illiterate in their primary 
language. However, the length and 
process of a vocational evaluation allows 
the evaluator to observe the individual* s 
behavior over a period of time, taking 
into consideration language dominance, 



and cultural background. In Lhis 

developmental model , the evaluator is 
alert to possible bias. Language and 
possible vocational limitations which 
constitute barriers can be di mini shed or 
overcome in some instances by the tools 
ust»d , work samples , career exploration 
activities, and techniques such as 
deMons t rations , model ing , diagrams, 
audiovisual equipment and other devices 
which tap different modalities. 

Values and Customs 

Cul ture ia the way an individual 
organizes and interprets reality in 
order to communicate and interac t in a 
.meaningful way with his environment and 
the members of his group. 

Social anthropologists have tr \ny 
ways of categorizing culture. Harris and 
Moran , ( 1987) categorize some of the 
aspects of culture as follows: Sense of 
Sel f and Space, Communication and 
Language, Dress & Appearance, Food and 
Feedir>g, Habits, Time and Time 
Consciousness, Relationships, Beliefs and 
Attitudes. 

Societies operating at survival 
level give the greatest value to food and 
shelter. This importance is in 

accordance with Maslow' s hierarchy of 
needs which starts with biological 
Sfjrvival. Societies which have satisfied, 
this basic need are concerned with thei 
acquisition of material things and with 
establishing complex laws (Harris and 
Moran, 1987). 

Personal space varies from culture 
to culture. While in Latin cultures it is 
appropriate to maintain close proximity 
to another person during conversation , 
other cultures may require more physical 
space between conversants. In some Middle 
Eastern cul tures, it is considered 
acceptable, even courteous, to lean 
closely to a listener so that he feels 
the impact of a speaker's breath. The 
acceptability of touching another person 
also varies among cultures. Latin males 
touch each other frequently while 
talking, whiU norh European males are 
much less likely to do this. Harr:.s and 
Moran ( 1987) describe the American 
perspective concerning personal space as 
folowsi "Americans believe that they own 
their bodies and they have a bubble 
around them that extends about two inches 
beyond their skin» If anyone breaks 
their bubble one must apologize and say 
' excuse me. ' " 

The va 1 ue a t tac: hed to punc tua 1 i ty 
varies among cultures as well. Americans 
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Place a great deal of significance on 
being prompt and utilizing time 
efficiently. This is a value inculcated 
in all advanced industrial societies and 
IS rooted in the demands o. coordinating 
complex economic activities which extend 
far beyond the family and community 
level. Now, after 200 years of time 
training in schooling and business life, 
Americans conduct most of their daily 
activities according to a clock-based 
schedule. But Latin Americans look at 
time in a more relaxed manner and may 
postpone projects until another day 
In agrarian societies, time is defined by 
the path of the movement of the sun, 
rather than in hourn and minutes. Time 
as a seasonal concept defines and 
influences long-range goals in global 
areas where work and leisure activities 
are influenced by marked seasonal changes 
Societies emphasize present, past 
and future time orientation. Societies 
based on a glorious history are oriented 
to the past and do not encourage planning 
for the future. Tradition is important 
and new. ideas and change are slow to take 
hold. Emphasis on the present 

discourages scheduling and saving for the 
future. The United states is a future 
oriented society. Jhi. spirit .of 

capitalism focuses on the future 
«Harrison, 19BS) . 

Social Systems 

An individual's. self-perception 
manifests itself within a culture in 
relationship to the particular situation 
he encounters at work, church, school, 
community, within the family, with peers, 
in groups or as a citizen of a particular 
government. These institutions in turn 
are the socializing mechanisms by which 
the society infuses values and attitudes 
and insures a sense of identity among its 
members . 

In American society, material wealth 
is seen as evidence of virtue, and it is 
assumed that if the indi>/idijal only works 
hard enough, he can attain his goal. In 
other societies, however, status does not 
always equate to wealth but is attained 
through family structure and leadership 
roles in the community. Age, likewise, 
may confer status, as status within the 
family may be more imporvant than status 
in tht? community (Harr and Moran. 

19B7). nora.i, 

Within the fafiily, child rearing and 
early childhood experiences determine 
adolescent and adult values. Children who 
come from war-ravaged countries 



experience more stress and view their 
world and future in a much different way. 
Unaccompanied minors, children whose 
parents have been killed, assume early 
responsibility and become head of 
households. In countries where the male 
IB the authoritarian figure, boys are 
treated with extreme indulgence. 
According to Harrison (1985) in Caribbean 
countries, children are greatly indulged 
and learn to expect immediate 
gratification. Then at age seven or 
Bight they are expected to be independent 
and are punished if disobedient. 
Children in these situations learn not to 
express independent, autonomous ideas. 
As parents, Americans stress cooperation 
and compromise (Harrison, 19B5) . 

Attitudes toward death and life are 
shaped by religious dogma. Some religions 
prescribe specific rules of behavior 
which control every aspect of the 
individual's life from birth to death. 
And in some religions the course of one's' 
life on earth is greatly influenced by 
specific beliefs in the hertafter. The 
,Judeo/Christian tradition place, 
responsibility squarely on the shoulders 
of believers; man is responsible for his 
own destiny. In cont ast, some religions 
explain what happens to divine 
interference. From the US perspective, 
this attitude, by limiting 
responsibility, limits potential 
(Harrison, 1985). 

Work Culture 

Webster (1965) defines "work" as 
bodily or mental effort exerted to do or 
make something; purposeful activity, 
labor, toil. To "work" is to exert 
oneself in order to do or make something, 
to do work, to labor, to toil. "Worker" 
is defined specifically as a person that 
works for a living, either by hand or 
brain, especially one who does industrial 
or manual work for wages. It is important 
to note that this definition does not 
assign a value to work, rather it 
emphasizes "effort." It is the culture 
which defines whether this effort is 
worthwhile or a necessary evil. And the 
■individual within that culture further 
assigns a value on that physical or 
intellectual activity depending on his 
specific circumstances. Some cultures 
encourage individualism, or the pursuit 
of individual career success, other 
cultures stress collectivism. In the 
latter model, the individual is 
suboroinate to the group. Why people put 
forth this effort, what motivates people 
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to work i« largely determined by the 
perception of the particular society. 

Recent research eeem* to indicate 
that Ma»low*» hierarchy of need* varies 
from culture to culture. Societies which 
stress quality of life and social needs 
put a lower value on productivity. In 
some countries job sft^iurity takes 
precedent over self actualization. 
Lifetime employment is more valued than 
risk taking and ego self actualization 
<Adler 1 1986) • American children are 
indoctrinated in the capitalistic way 
early on. Parents pay children to do 
chorfs, and older children are encouraged 
-to work part-time after school. 
(Harrison 9 1985). 

Career planning starts early in 
American schools and the belief that 
productivity and self-actualization are 
valuable is inculcated early. The 
english word for "achievement," however, 
is difficult to translate to other 
languages. In some cultures people work 
to fulfill basic needs, to survive, or 
for the concrete income that the work 
"effort" produces. Work as a commitment! 
to the welfare of one's fellow countrymen 
:and to religious duty is prevalent in 
countries where religion mandates this 
value. Thus the origin of the Puritan 
work ethic which now implies that hard 
work alone will allow one to achieve 
.one's goal. Implicit in this assumption 
is the belief that the individual can 
control his destiny .ftnd is responsible 
for his actions. Some cultures do not 
share the belief that work in and of 
itself is valuable and worthwhile or that 
individuals can control their destiny. 

Wisdom, fate, and other not so 
subtle attributes have an equal part in 
explaining individual success or failure. 
For example, the southern Italian 
peasants who came to the United States in 
the millions between IBBO and 1920 were 
sMtremely hardworking, but not because 
they valued work as such. It was because 
of their beliefs about fate and about how 
working established an individual man or 
woman's worth within the family mnd local 
community. A hard working person was 
someone whom the group - primarily ths 
family --could count on in a harsh and 
difficult world. These valuer were in 
turn rooted in the economic and social 
circumstances which had shaped their 
world for centuries. 

Learning Styles 

The fundamental manner in which 
people learn is determined by custom. 



Children in some societies learn by rote 
memory. Information is presented in a 
manner that leaves little room frr 
discussion or bui Iding independent 
thinking skills. Certain rewards and 
punishments are attached to the 
acquisition of information in a 
determined way. The experiential , 

deductive, approach to learning practiced 
in Western societies stresses abstract 
thinking and conceptualization. In 
contrasts Eastern cultures favor 
intuition, mental images and symbols 
(Adler, 19n6). Likewise, Native Amrtrican 

. parents teach their children mainly 
utilizing the visual modality. As a 

' result Native American children develop 
strenths in the visual modality and 
often demonstrate weaknesses in the use 
of verbal language. (Mattes and Omarkf 
19G4) . 

The Int^ trview Process 

The awareness of cultural 
differences impacts the assessment 
process most critically during the 
interview. The initial interview is one 
of the most important aspects of the 
vocationiil assessment process. During 
the interview, it is essential that 
rapport be established. A respectful , 
caring relationship facilitates an 
atmosphere for which people who do not 
share our common values/belief system can 
feel less threatened and at ease to 
express their views. This requires a 
great sensitivity on the part of the 
evaluator . 

Furthermore, evaluators must have an 
awareneos of the impact their culture has 
on the interpretation of their own 
real ity and that of others, 
ethnocentrism, the emotional attitude 
that one's own race, nation, or culture 
is superior is the absence of that 
awareness. Awareness establishes a point 
of reference without which the evaluator 
cannot identify differences in other 
cul tures . Awareness diminishes cross- 
cul tura 1 misinterpretations. 

Effective interview ski 1 Is are 
fostered by an open minded approach on 
the part of the evaluator. A receptive 
climate should be encouraged so that the 
evaluee feeli free to openly express his 
interests, strengths, dif f icul tier, and 
concerns. 

According to Plata (19B4), the 
Interviewer should be aware of both 
verba 1 and non verba 1 modes of 
.communication. Familiar jargon, idiomt 
and colloquialisms should be avoided to 
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reduce the already existing complexity ot 
the English language. Likewise, written 
information should emphasize simple 
wording, language and sentence structure 
to ensure the individual ' s understanding 
o-f the intended question. 

Establishing r apport is the goal oi 
the interviewer. However, sensitivity to 
the individual '5 ciil tural values and 
customs must be maintained to de- 
emphasize approaches which may be viewed 
di-f "ferently from the norm. As Plata 
notes, if the individual appears 
uncomfortable maintaining eye contact, 
eliminate this as a priority. If a 
question appears tno personal, skip it 
and proceed to a Iwsis sensitive topic. 
Commonly used gestures should be avoided 
to reduce the risk of misinterpretation. 
For example, Yao (19BB) notes that using 
the index finger to call another person 
may be perceived as an insult by an Asian 
individual, as this gesture is used with 
animals. Furthermore, some Asian 

individuals may avoid eye contact, 
thinking it impolite. 

Every effort should be made to make 
the individual feel comfortable and non- 
'threatened. Allow the individual to 
IwxpresB himself freely, utilizing any 
standard or variety of language with 
which he feels to experience" the 
individual's world and share their 
experiences, rather than judge them. 

When we consider cultjre in the 
interview process, it is important to 
consider these ecological factors. The 
variables which constitute an 
individual's ecology include values, 
beliefs, customs, social systems, and 
manner of communication. These 
constructs combined with physiological 
determinants in turn determine an 
individual's style of working and 
learning. This is the essential mission 
of the assessment process. 
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Abstract 

Ihe purpose of this paper is to describe the 
vocational assessment process utilized at the 
Project EYE Transition Center located in 
Canton, htossachusetts. The Pnaject EYE 
Transition Oenter was created two years ago 
inorder to meet the ccnpetitive eaploym^ 
needs of severely physically djallenged young 
adults who axe graduating ftxm special 
education programs or those unaplqyad or 
unoewnployad after leaving achool. ihe goal 
of the program is to provide evaluation and 
enployment services which will assist the 
oonsumar in obtaining non-aubBicJlzed, 
owpttitive «Gnplo:pent in their local 
aamxnity. Ttyt program is currantly 
ocnpleting tha third year of a thXM year 
grant pycle fUnM by the D^»rtm«nt of 

spe^ Bducation and HAabUitaUon Services 
intt» category of Sp«3ial Projects and 
wnionstrationB for providing Vocational 
Rehabilitation Services to Severely Disabled 
Individuals. 

A rwLm of ths history of vocational 
•valuation rsvaals many Inef f icimcies and 
lne(|iitlss when using stanlard pitxxdures to 
P«»dlct aiploynent potwtial of the scrverelv 
pny«ically disabled. One najor inKjuity is 
that standardized testing focuses cn aptitude 
and ^11 level rathwr than functional aJdlls 
and worit potsntlal. in order to tOdcma tliis 

Mvelqp an altsmativa model of nmasmmnl 
that would f oous on dntsrmlning the 
functional abUity of the Individual and 
using that information to predict the work 
potential, nils usswrwmont prooMs includes 
three oomxiwits: a) selective standardized 
terting, b) wor)C8aii|)llng which is designed to 
be adapted or modified, and c) situational 
aMesaaient that is time limited and ocamanitv 
oaeed . ihe approach is individualized and 
nexlbility and creativity are key factors to 

^ Intensi^ and 
thereby utilizes the entire rehabilif;ation 
team, including envlcyers. lb* vocational 
evaluator serves as assessment -jirdinator 
required to draw on non-traditicnal sJdlls 
(marketing and job developroant, counseling 
interventions and resource ooortUjiation) in 
conjunction with traditional assessment 
techniques. 



JNTBGOKmati: 

Ihe difficulties inherent in assessing 
the vocational potential of an Individual 
with severe physical disabilities are well 
documented throughout recent literatur© 
(Frank 1987, Ayella, Le Cente 1987, Alfred 
1986) . All too frequently the use of 
standardized testing, worksaapling and even 
situational assessmoit in sheltered 
environnents has served to rule out the 
candidate fpcro serious consideration for 
ocn|)etitlve eajrployment or more significantly 
rule than cut of eligibility for vocational 
rehabilitation services altogether. (Ayella 
LsOonte 1987) . Nhan Projert EVE Tcar«ltion 
Oenter wes cxeatad In 1986 one major 
ocnfxsnBit of the projec t was to oontlnue to 
d«ve?.op an evaluation model that will predict 
and enhance the vocational potential of the 
•wrtftTBly physically disabled Individual. The 
following docunentation will Illustrate this 
alternative process with case studies of 
ccnftaners vAw utilized the Center's services. 

JBwinnlnq the Process! The initjui Trt^f^rfjr' 

Cnoe referred, an individual takas part 
in an initial intnrview, thus allowing the 
four person plaoenent team to meet the 
^licant and vica versa, it is designed 
slnilarly to a job interview however the 
ocntert is more oonfirahsnsive. The main 
purpose of this Interview im to coq>lore the 
E-rtinent issues essvitlal to jdj plaoenent 
i.e. KKxmxiOsftijotm needed, aadlcal 
nianag«ant, tranipartatlcn alcng with 
identification of vocational Interests and 
cualificatlcns. Ma look hate not only for 
iiifonnatlcn but for a sarsw of the 
a-^icant's awarvMns of their WTvironnent in 
9^vieral. Ihrough this process we note any 
•xv-emal obstedas to anplqynant; i.e. lack 
of transportation, and prioritize needs; i.e. 
is the applicant medically stable enoi^ to 
consider permanent enplpyment either n a 
part or full tlm basis, lhase interviews 
also begin the process of determining the 
level of services the applicant may need to 
obtain and sustain enploymenh based upon the 
individuals self-awareness of their own needs 
and their environment. Pfmonrrh on the 
cui:rent p5.x>ject shows that two key factors 
slgnificanUy affect jcb longevity. 
Successful candidates dewonstrate l. an 
awareness of their enviromant and urrierstand 
its iitpact on work 2. motivation to maintain 
emplcyment based on previous personal 
history. 
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of Selective stan ^T^^^-^ T>estirKi and 
WorksgUTPlinq 

The ne>ct step is a six to eight hair 
period of testixig and thorough review cf all 
available reoonis. Testing includes both 
written tests and woricsanpling. Ihe 
worksanple system xxtilized is hcrocmade and 
^jecif icsilly designed to be adapted as 
needed. Written tests are also modified as 
needed* Expanded tins lineS; writers; 
enlarged print, line grids etc. are the rule 
rather than the exception. Normative 
information is rarely usod and results are 
viewed functionally rather than in 
standardized fashion. Ihe major purpose of 
this part of the assessment is to "get to 
)aiow*« the applicant. It serves sonewhat liJce 
a pre-eiiplOi^i«fTt screening tn determine skill 
levels, interest areas and tjBnparament. The 
Information provided by this assessment is 
mostly used to develop one or mcKre 
Impropriate situational asseseanent sites. 
Occasionally this segment underscores an area 
of need \*ich nust be addrwsed prior to any 
develcpotttt of a plaoeofint. For exanple, C.G. 
was referred to Project EVE Transition CSenter 
while still in Hic^ School. He was diagnosed 
with Ottr«faral Palsy and was a functional 
quadriplegic. His intellectual functioning 
was below average. C«6. was assessfld at an 
ad^)ted ocirfuter and demonstrated potential 
to operate user friendly programs. He however 
had mln^i^i exposure to vocational 
e^lications on the oonputer. C.G. was 
inmture both in his vocational goal setting 
and in self-awareness and self-advocacy. 
ThereforB it was reoonwended that he receive 
vocational training and career awareness 
education prior to entering a program with 
the goal of cannunity placement. 

SitWitiawl ^^asessnent; The Value of 

Phase three of the evaluation process is 
one or mare time limited assessment 
opportunities. Whenever possible these are 
conducted in a oonnunity based setting. Ihe 
Washington State Project researdi has 
demonstrated that "oorounity based time 
limited vocational assessment" is effective 
and provides ••vicible oomunity intx>gration 
of those involved" (Fey, Ruddy 19B7). 
MDreover, the molti-physically disabled 
individual has had little or no o|portunity 
for vocational development. Because of the 
lack of evidence to support vocational 
potential a multi-model approadi is 



reoaimended. (Flynn et.al 1983) Ihe 
8U3sessinent approach needs to be corprehensive 
and irulti-phased, utilizing a variety of 
resources to develop an optiitum assessment 
tool. (Finn and Destefano,1986) Ihe 
inportanoe of a comunity orientation is well 
documented. The evaluation unit nwst be 
relevant to the oonwunity it serves. Pudrud 
(1987), states that jcb opportxanities in the 
cjonwunity should be researched prior to 
iirpleraenting a job training and placement 
program. Worksairples and job evaluations and 
jci> analysis are key tools that are utilized 
durinj this process. We have found that 
comunity based situational assessments 
provide a concrete reality test for the 
aypplicant while providing an assessment of 
work tolerance, interpersonal skills and 
interest in the job. A very valuable effect 
of this type of evaluation is that our 
candidate have gained self confidence both 
in their skills and work readiness. 

In one exanple Bill, a 23 year old male, 
was referred to us for evaluation. He has 
been diagnosed with Spina Bifida since birth 
and uses bilateral crutches to antwlate. Bill 
was a graduate of a local high school with no 
particular vocational training although he 
had taken shop courses. Previews vocational 
testing supported aptitude and skills in the 
manual trades and reooranended training in 
this area. Bill had been enployed in a 
factory but quit because advancement 
poGsibilities were not offered and he was in 
jeopardy of loosing subsidy anJ medicaid 
without job security. Bill had been turned 
down by a Private Inrlustcy Council machinist 
training program because of his disability. 
After record review and some updated testing 
Bill took part in a three week trycut in an 
adaptive design workshop on the grounds of a 
rehabilitation facility. He performed entry 
level machine operations and also ccnpleted a 
special project from sketches. 
Simltaneously, as part of his assessment. 
Bill tried out a data entry job in the 
offices of Project EYE Transition Center even 
though he had ^ prior oonputer experience. 
When workiJig on the oonixtter. Bill understood 
how to use the prxxfram but his perfort\anoe 
was very slow and hani^ered by his limited 
educatiOT in business operations and business 
English. He chose to discxDntinue this task. 
In the design workshop hcwever Bill performed 
with skill and was offered a paifc-time 
position. Bill chose however to enter 
machinist trainirq (the same whic±i turrked him 
down uarlier) which this evaluator 
eiKXXiraged. Bill is currently enployed in a 
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nachine shop with potential to leam 
cxxiputer assisted manufacturing. His salary 
is $7,00 joer hour. 

Bill was rewarded with direct feedback 
frm an otployer in his field of interest, 
which gave rdm the oonf idenoe to advocate for 
appixDpriate training and to risk financial 
independence. EvidenUy, the evaluation 
process described was successful in creating 
the opportunity he needed to build his 
confidence • 

ahe MUlti-Faoeted po^ e of the I p^/^ luator! A 
Key F^qtoy 

A key difference of this type of 
evaluation is that it is highly 
individualized md labor intensive. It relies 
heavily on the flexibility of the applicant 
and the employer and on the creativity and 
energy of the plaoeroent team. Ihe vocational 
evaluator uses skills not traditionally 
called Mpon in the standard assessment 
procedures. In traditional evaluation the 
evaluator provides a needs assessment, 
develops an irxlividualized evaluation plan, 
selects toolft from their test library, worlc 
sanple systeBis or wortehop tasks, carries out 
the plan and r^rts results. This process is 
primarily a one person operation and the 
resources are found within the confines of 
the r^wbilitation facility. In the 
alternative model we describe, the evaluator 
nay inore apUy be tiUed resourcse 
ooorcUjator. S/he is called upon to recruit 
ajployrrs, coach applicants, coordinate 
cxaronlty resources like trani^xjrtation, 
provice counseling interventioiw as needed 
etc. i^t all tiiDes the input of the laaceroent 
team (^ job developer, rehabilitation 
cxxjnselor, trans^rtation coordinator and 
program director) as well as other outside 
agency personnel and employees is solicited 
and utilized. This is a highly challer^lng 
and rewarding process when it is utilized- 

Resguroe Ooordination! d efining Q pt^n^g 

In a brief exaiiple Jiirbo, a 26 year old 
nan who is quadriplegic as a result of Spinal 
Cord Injury , cane to Pcoject EYE Transition 
Center because hie was uncertain of his 
vocational potential. Jinfco worked in a basic 
skills job from the time he quit high school 
ih t}.ie tenth grade. He was educationally 
disadvantaged however, he had had a suooessful 
s 'X year work history and was to be prtmjted 
to supervisor at the time of the injury. 



Jinbo was interested in further schooling 
twt also in exploring vocational options 
available to him. As part of assessment we 
obtained, or ^oan, an optical light pointer 
to provide coitputer access. Jinbo learned to 
use a data base program, and perfonned data 
entry. LUce the previous case, Jiidbo's 
limited educational skills hanittred his 
conpetitive production rate However, Jinho 
was inspired by his ability to use a oonputer 
in a business application. Reccimiendations 
included an asseseinent of the most 
appropriate technology for Jii(k)o to lose in 
school or In the workplace. TXitoring in basic 
academics and business practices was 
soggesteA. Job titles in gistoiner service, 
inventory control and parts order and stock 
clerk were identified. 

Pewards! Developinci S elf Oonf idenoe anc^ 
Reality Te stincr 

John's case illustrates the cumulative 
nature of the evaluation process. John is a 
19 year old male who had a Gardio Vascular 
Acci d e n t at an eariy age. He has a right 
sided heni^legia primarily effecting his arm 
and hand and significant learning deficits as 
well, especially in reeding. John expnessed 
interest in electrxxiioa assembly and also in 
child care although the latter was primarily 
an interest because it seemed **easy to him<^ 
Vte developed simultaneous situational 
assessments, one at a local daycare center 
and the other at a local manufacturer of 
testing equipment. After two weeks John 
reported frustration at the day care center 
and that site was terminated early. At the 
manufacturer John was required to oonqplete 
semi automated circuit board assennblitt. The 
evaluator was required to attend all tryout, 
to train and assist John wit'.t his task. On 
day one John was required to assanble by hand 
the connectors to « PC board. Ttiis requires 
fine finger dexterity with small parts and at 
first glance seemed to be a two handed task. 
Despite the suggestions of several sinple 
ad2^7tation6 John became obviously frustrated. 
For the eveduator imich of the day was spent 
acting as counselor, listening and 
empathizing while this young irtan experienced 
an event which underscored his disability and 
caused him pain and frustration. John then 
txxk a brief self initiated sick leave. He 
returned with renewed energy and various 
cotpensatory strategies to try out. After ten 
to fifteen hairs of tryout, John had 
demonstratid the ability to ccnplete all 
aspects of the assembly. His speed on manual 
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taaks was well below oonpetltlve standards. 
HcMWiar with time, apprcpriate adaptatlors 
ard job nodlf ications and ocntinjed aappovt. 
th* Projact EYE Transition Oentar taam is 
oonf ortabls rsoonnending plaosmont as an 
entry level 8«ni aubGnatsd electronics 
assonlsler or related position. John's 
frustration tolerance and perserverenoe were 
dearly Idantif ied as vocational strengths as 
was his ability to ocnpensate for his 
physical limitations. 

tto believe that we have designed a 
vocational evaluation modal which enables the 
eevsicely disabled to beoone actively involved 
in ooBpetitive, ooRBunity based aBftLoynent. 
our suooees rate has anoouragad state 
vocational rehabilitation persoraial to taloa 
van risks with this hard to place 
population. For the job applicant, this 
prpness is oftsn a positive experience which 
buildto oonfidanoe and self advocacy skills. 
For the crvaluator, this pi 'ooasB offers the 
challmge of utilizing the full ripeetoire 
of lehBdaUitation aounsallng and evaluation 
skills. Moraovw the svaluator is not alone 
oaneying tha scsftliw weighty responsibUity 
of dstetaining the voaational potential of 
soneona but iM part of an active forward 
looking teen «*K9se goal and expeotatlcn is 
acn|)«titlva plaomnt for all applicants. 

m smmiy, this approach to asaeaaent 
has several bwefits: l. The aasesaniant 
mirrors the natural pnxe as used in a s s e ss ing 
non-disabled wotkars; that is the IntervieM, 
pr«-«Bplaymant screening and perfonmnoj 
evaluation regularly required for job 
applicants. 2. The iissesemint is functionally 
based and identifies work skills and 
biliaviors, motivation and physical 
capeoities. 3. The external factors affecting 
work intiy, i.e. t ra n spor t ation, family and 
social factors, nadical is suee ar e 
throrouc^y assessed and appropriate 
intervwition is identified. 4. The porediction 
of ocnpatitive enployability has been 
relativaly high: 99% of persons evaluated 
usirq this method have maintained anployment 
for a minimum of ek^ months. 5. The 
consumer has concrete experiense upon vMch 
to build confidence, increase self-eet«»«n and 
clarify interests. 6. For the evaluatot, this 
approach offers an opportunity to be 
professionally challenged and function aa a . 
team martoer. In this model the etvaluator is 
no longer an isolated cxmsultant hut 
coordinates all aspects of the assessiront 



process. 
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Abstract 

A Vocational kf^^f^^^ma nt Tool for Severely and 

Profoundly Developmentally DlaabTT ri 

Populations 

This paper will focus on information re- 
garding the development of a vocational a- 
asessment tool for severely and profoundly 
developmentally disabled populations. This 
assessment tool, the Illinois Vocational In- 
terest Survey and Assessment (IVISA), was 
developed to comply with the Carl Perkins 
Act, accrediting agencies and the Illinois 
State Board of Education, Department of 
Adult, Vocational and Technical Education 
guidelines. The IVISA was developed by 
vocational staff w.thin the Illinois Depart- 
ment of Mental Health and Developmental 
Disabilities (DMH/DD), and addresses 
standards regarding interests, abilities 
special needs, work-related behaviors and 
work skills, as well as present and future 
employment options. The specific items are 
organized In four broad occupational areas: 
Home Economics, Business, Horticulture, and 
Industrial. The IVISA will be used at 
approximately thirteen dMH/DD sites in 
Illinois to help place students in appro- 
priate vocational programs based on 'rheir 
needs, interests, and abilities. 



IS 2 



The Illinois Vocational Interest Survey and 
Assessment (IVISA) was developed within the 
State of Illinois by che Department of Mental 
Health and Developmental Disabilities, This 
department is charged with assuring the rights 
of and meeting the needs of mentally ill and 
developmentally disabled persons within the 
State of Illinois, Besides licensing 
residential and program service agencies in 
communities, Illinois operates over twenty 
t.^sidential facilities, within certain of 
those facilities reside individuals who are 
severely and profoundly developmentally 
disabled, many of whom have compounding 
physical and sensory limitations. It is 
believed that this population, with its special 
needs, retains the right to learn and develop 
vocational skills. It is also believed that an 
accurate vocational assessment is paramount to 
beginning vocational education and the results 
of such assessment are valuable aids j.n 
planning for each person's individual goals and 
objectives. The purpose of the IVISA is to 
measure the existing vocational skills and to 
determine possible areas of vocational interest 
for this targeted population. 

To assure that the assessment process 
adheres to established standards, various 
accrediting and certifying bodies were 
researched and applicable guidelines were The 
Illinois Vocational Interest Survey and 
followed in the search for an appropriate 
assessment tool. Reviewed were guidelines 
from: the Health Care Financing 
Administration, the Accreditation Council for 
Persons with Developmental Dieabilities, the 
Illinois Department of Public Health and the 
Illinois Department of Public Aid. Also 
reviewed .-vq the requirements of the Carl D. 
Perkins Vocational Education Act, The Act 
signed October 19. 1984 stipulates that ' 
vocational assessment must be comprehensive, 
ongoing, and systematic and should include 
cumulative data review, career interest 
testing, aptitude and ability test, g, as well 
as information from the individual being 
assessed. 

In conjunction with the Carl Perkins 
Act, the Illinois Department of Mental Health 
and Developmental Disabilities (DmHDD) 
cooperated with the Illinois Department of 
Adult Vocational and Technical Education of the 
Illinois state Board of Education during 1987 
to Jocal.o a standcirdix.od vocaLionai assGHsmont 
tool that IS .propriate for the targeted 
individuals. Since no standardized assessment 
appeared to meet this population's special 
needs, a task force under the auspices of the 
Ulinois DMHDD Education Services Board was 
developed to compile an assessment tool. This 
assessment tool is based upon (1) a 
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rov'n^w of i\\\(]i\Vi\\ /.c(] vocdl ional .u;ju^;;;uii<mU j; 
f:or mL.ldJy and moderaLeLy doveloprnenta Liy 
disabled people and (2) vocational 
aj5sessment;s developed in-house by long-l.erm 
care state operated residential facilities in 
Illinois . 

Based upon standards and guidelines 
reviewed, the following objectives were set 
for the development of a vocational 
asses^sment system: 

1. The vocational assessment tool must 
be useable with (a) individuals who have 
severe and pre ound developmental 
disabilities, (b) individuals that are not 
enrolled in a vocational educaticn program 
and therefore may not be familiar to or known 
by the testor, and (c) individuals who may 
appear an unresponsive and passive 
population . 

2. The tool must be developed to 
supplement and provide additional information 
that may not be provided in a standardized 
assessment . 

3. The scoring system must: bo modeled 
after a standardized form in order to be 
recognizable, have a cumulative score to rank 
recipients, be reflejtivft of the model 
assessment tool, be commonly known to most 
vocational staff, and not require special 
interpretation . 

4. The tool must have line items that 
are small measurements in order that after 
each annual assessment, progress can be noted 
from the previous assessment, thus verifying 
appropriateness of continued approved 
enrollment . 

5. The tool must reflect the 
recipient's interest by one of four 
occupational areas, such an: Business, 
Industry, Home Economics, Horticulture. 

6. The tool must assess employability 
skilli;. 

7. The materials in the tool must be 
cost feasible. 

8. The tool must be relatively short in 
application time. 

9. The tool must address standards 
regarding work interests, abilities, skills, 
work-related behaviors, special needt, 
present and future employment options. 

10. '^he tool must produce results that 
interdisciplinary professionals can use to 
determine the appropriateness of vocational 
programming . 

Thus, the IVISA was developed and 
consists of three components. The first 
part, "Vocational Skills and Abilities" 
consists of eighteen tasks that measure 
reaching for, grasping, manipulating, 
transferring, disassembling and assembling 
simple work items. The seconu -^ection is 
divided into the four categories ( Indu.^>tr ial , 
Hn.s i fUM'vi;, llofnc^ Kcoru^m i cs; , .irui liort icu 1 tur<j) • 
liach .section has eight test items that 
determine abilities to perform tasks related 
to the category. The 1 ndvi.slr ifil line items 
Cocui; on putting object.*^ in containers, 
snapping J ids on bottJes, el c. In the 
Business component, the individual is 
assessed ror skills such as: folding paper, 



u;;iiui .1 ruhluM* :;t.iiiip, sc i s.sor:; , p.ifnT clips, 
iiuiliny labels, and yiue. The Home L'conom.cs 
.section measures stirring, wiping, stiiffim, 
and sowing. Horticulture line items call t'cr 
the person to pour, measure, sort seed packets 
and other related tasks. Results of this 
second section, "Occupational Interest Survey 
and Assessment," reflect the greatest area of 
the person's expertise and/or interest. The 
remaining section is "Employability Skills" and 
consists of a checklist of fourteen work 
habits, the cum\i itive results of work interest 
review and/or interview, any career 
expectations expressed by the person being 
assessed, strengths, special needs, and 
present/future employment options. 

The materials used to administer the first 
and second part of the IVISA consist of; 
tubs/bottles with screw-on or snap-on iids, 
paper, labels, stamp and pad, scissors, 
envelopes, paper clips, index cards, glue 
stick, plastic gloss and spoon, washcio'ii, 
sponge, needle, yarn, plastic mesh, wooden 
block, dowel rod, metal/wooden bolts and nuts, 
plumbing pine, plastic roller, felt-tip marker, 
water, paper towels, flower pots, plant stakes, 
seed packets, silk flowers, measuring pitcher, 
cloth, and a spray bottle. The test items are 
grouped according to the order of the IVISA 
line items, and packaged in plastic bags. All 
test items, the instruction manual, and scoic 
sheets are packed into a washable duffel bag. 
The finished product is portable and light 
weight, reusable and replaceable and the 
initial expenditure was affordable. Five IVISA 
"bits" were given to various Illinois 
facilities in March, 1988. A part of each bit 
was a video tape, demonstrating the 
administration of each line item. Training was 
also provided to vocational staff an^l a 
state-wide network established to answer 
questions or provide information as needed. 

Remaining IVISA kits were disseminated in 
April of 1988. Field testing continued through 
December of 1988. In January of J 989 the IVISA 
began review based upon input from all 
f acilit ies conducting field testing . 
Researchers have been contracted to study the 
IVISA field test results for reliability and 
validity . 

It is hoped that the WISA will reflect 
each person's learned skills, potential, areas 
of needs, and reveal an area of interest or 
preference for work related tasks. Also a hir;h 
score on the IVISA may indicate the need for 
administration of a standardized vocational 
assessment- The IVISA may also be administered 
to measure information and skills that were not 
revealed during a standardized assessment and 
thus serve as a supplement to a standardized 
assessment. The TVISA may document that some 
individiinls will l.ick basic rcrichinc], <:)rm;p inq 
.ind manipulation skill:;. 'I his i nl (jrmat ion can 
be then used by Inteniisc ipi.i nary teams to 
determine the appropriateness of vocational 
{'diJCrit ion, or the need tor training c/' 
pj-erequ isit.e skills. 

The IVISA, in i ts initial f'oT-in, has i)f?en 
cof>Yrightod for the Illinois Dep<irtmont of 
Mental Health and Developmental Disabilities. 
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Inil.ial I'oodback ( rom Spec: ui I Kduc.jl or;; , 
Vocational Instructors, and Rohabi J. i t.at Ion 
CounHoJors and olhor.s who havo acLuaily 
administered the IVISA have been very 
positive. Upon rosLdts of the contrnctod 
researchers, any necessary revisions to the 
IVTSA will be made, it is expected that 
norming studies will show relative 
correlations, it is aJso hoped thit. the 
fVISA will provide insight for profes.s ionai:; 
and staff who work with severely and 
profoundly dsvelopmentally disabled people. 
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VOCATIONAL KVAI.UATION OK IM'iKSONS WITH 
COMIilNDU HKAKING AND VISUAL IMPAJKMt^NTS 



Linda Mathias Kaskel, M.A.» C.V.E., C.R.C. 
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Many vocational evaluators are not 
prepared Lo work with persons with 
hearing and vision impairments. 
R V a 1 u n t i n fi persons with s e n .s o r y 
limitations are a challenge and it oTlcmi 
requires an understanding of the unique 
difficulties in communication, mobility, 
and general orientation of this 
population. As the priorities of 
rehabilitation services continue to shift 
to serve individuals with Kovcro 
disabilities, more and more persons with 
vision and hearing impairments will be 
requiring vocational evaluations. 
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ere has been an increase of 
s available to persons with 
and vision impairments in recent 
Sisson, Van Haaselt, and Hersen 
speculated that the dramatic 
e in clinical and investigative 
rs for persons with severe and 
d disabilities was due to three 

The first was the changing of 
and professional opinion about the 
al of these individuals. The 
factor was a need for greater 
nihility in providing humane 
tional se^'vice for this 
ion. The impact of the 1964 -1965 
epit.emic in the United States was 
rd factor. In addition, the 
g medical and mechanical 
ogies are making it possible for 

with severe disabilities to be 
bile and integrated with society* 
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Sisson, Van Hasselt, and Hersen 
(1987) accentuated ChaC a person's 
ability to function with visual and/or 
auditory impairments is unique and 
dependent on such factors as degree of 
sensory loss, intellectual levl, 
intervention available and the presence 
of other handicapping conditions. 
Vocational evaluation for persons with 
multiple handicaps needs adaptations of 
ii s s e s K m e n t tools and methods of 
administration (Cheung, 1983), The 
analysis of referral information and 
intake interview are important initial 
steps in developing the individual 
vocational evaluation plan for persons 
with hearing and vision impairments. 

THE INTAKE INTERVIEW 

Andrew (1973) highlighted three 
goals for the initial interviewi a) to 
build a foundation for the helping 
relationship, b) to begin to open up all 
of the psychological realities in the 
client's situation, and c) to clarify the 
structure of the helping process. When 
working with persons with communication 
deficits this may also include modifying 
standard conditions to optimize the 
persons potential. 

Watson (1976) points out the 
importance of collecting a variety of 
biographical data in the vocational 
evaluation of a deaf client. Pi'ior to 
the development of the individualized 
vocational, evaluation plan (IVEP), a 
through intake interview is necessary to 
obtain information about the nature of 
the disabling conditions, activities of 
doily living, communication systems 
utilised, mobility orientation, 
adaptative devices needed, educational 
history, vocational experiences, the role 
of the family, and previous access to 
social service systems. The following 
areas are listed ac guidelines to assist 
in the interview process and should be 
completed in order of prior.^ty as 
determined by the individual client and 
the vocational evaluator. 
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Activities of Daily L iv ing 

During tl'is section of the 
interview, information is gathered 
regarding the individual's self ca 
home maintenance and safety skills 
the client dress himself/herself? 
he/she wash, mend, and sew his/her 
clothes? Is he/she physically abl 
clean and care for small maintenan 
problems in the home environment? 
indi^ *,dual aware of home safety ru 
Is the client capable of purchasin 
preparing his/her meals? Is he/sh 
familiar with eating in restaurant 
Does the client have his/her own s 
account, checking account, and/or 
card? Has lie/she ever applied for 
credit? If not, is he/she familiar 
the process? What does the person 
recreation? Does he/she have a sp 
hobby, sport or skill? Doe.<= he/she 
to any social, civic, religious, o 
professional organizations? 

Commun i c ation System s 

Vei'^al and written communication 
difficulties can be major obstacles in 
every day living as well as tlio 
vocational evaluation process for persons 
with combined hearing and vision 
impairments. What are the client's major 
communication strengths and lim' ations? 
Does the person have the abilit> to 
clearly use expressive verbal speech? 
Does he/she use appropriate voice 
modulation and projection techniques? 
What arc his/her receptive s^^ech skills? 
Can he/she use American Sign Language 
(ASL) or "homema-i" sign gestures? Are 
there ranges for eptimal sign reception 
(near, far, centered, off to one side)? 
Has the person ever used an interpreter? 
Was the interpreter a family member, 
friend or certified professional? Was it 
a success e x p o r i e n c c ( s ) ? How does the 

person use his/her body language 
(posture, facial e x p r (vs s i o n s , \\ c s t u r r s ) ? 
Has t li e client !i a d any previous 
formalized language training? If so, for 
how long and what were the outcomes? How 
does the i. ndividual use written print? 
Is he/she functionally literate? Can 
he/she u^o standard size print? Enlarged 
print? At what spiked and duration of 
use? Can he/she use Level U braille? 
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Does lie/sho the L e I c'plio iu« , Tni). ur 

amplified telephone? For social contact 
or emergency use only? If the t licMiL 
does not have a phone in his/lier homo 
environment, how does the person make an 
emergency call? Mow will he/she call in 
sick to a training program or employer? 

M obility Orientation 

The client's report on his/her 
mobilily skills is nceesHiiry. How does 
he/she travel in familiar settings versus 
new environments? Is the individual 
capable of self travel? Does he/she 
require a cane or dog to aid in mobility? 
Or is a personal companion required for 
outside of the home environment? Are 
there special environmental clues that 
can be utilized during the vocational 
evaluation to assist the client (such as 
rubber mats or pieces of carpeting to 
indicate exit doors)? 

Adapt ive Devices 

During this section of the intake 
interview it is important not only to 
dssess those adaptive devices that the 
individual is presently using, but also 
to find out whether the client has 
knowledge of other equipment available. 
Does the client use either 1 i gh t / s t r o be , 
loud sound, or vibration, or variable 
velocity fan alarms for clocks, smoke/ 
fire detectors, doorbell buzssing and/or 
phono ringing? Does the individual use 
amplified hearing or vision devices (such 
as hearing aids, telephone amplifiers, 
induction loop sound amplifying systems, 
specialized lenfj, magnifiers, telescopes, 
CCTV)? If so, how long has it been and 
what type of training on the device was 
provided before use? Does the individual 
possess enough sound reception to utilize 
"talking" tools (such as watches, clocks, 
calculators)? Does the person have 
sufficient vision to utilize a 
telecommunication device for the deaf 
(TDD) with standard si;5e or enlarged 
print screens? Does the client use 
brailled tools (such as watches, rulers, 
food labels)? Can he/she benefit from 
the use of a writing guide? Is the 
person .'amiliar with closed captioned 
television programming? Can he/slie 
utilize a television caption decoder? 
Does the person have access to a personal 
computer? Is the individual aware of the 
modifications that can be utilized with a 
porsonnl computer? Does the client know 
about vibrating pager systems? 

Kdu rational _ Hi s t or y 

In assessing the individuals 
educational background several general 
questions should be asked. How many 
years of form-lized education has .hn 
person completed? DiJ he/she graduate 
school or complete certificate program? 
What typo of specialized services, if 
any, were provided? What were his/her 



Veported successes iind l a i lures? whai. 
type of extracurricular activities, ii 
any, did the person eii J oy wh i 1 o in 
school? What are the individu U ' s 
residual functional academic skills (for 
example! mental math, counting, telling 
time, measurement, money, recognizing 
safety signs)? What are his/her goals 
for future training or continuing 
0 d u c a t ion? 

Vocat ional Kxpe r i e % c ♦> 

A full and aetaiied job history is 
needed for any client with previous work 
experi.ence. What were the jobs held pre 
and post onset of the disabling 
conditions? What specific job 
accommodations, modifications, or 
adaptative devices were utilii;ed? What 
does the individual report as his/her 
vocational assets and limitations? What 
method(5) did the person use to obtain 
the job*? Why was he/she terminated? 
What level of vocational awareness and 
amount of career information does the 
client possess? What is his/her current 
and future vocational goals? Has the 
person had any volunteer experiences or 
avocational activities? Does the person 
have any experience with self directed 
job seeking activities? If so, how 
successful were they? 

Rojj g of Family 

The impact oT fiimily and signifieaiil 
others is also an important component of 
the person's life to assess during the 
intake interview. What is the person's 
current living arrangement? Are there 
dependents (spouse, children, aged 
parents) depending on the income of the 
client? Do any other members of the 
family have a disability? Where does the 
individual live (geographic location) in 
proximity to family, friends, employers, 
and medical support? What is the present 
method of financial support? What type of 
emotional and/or social support from 
family and significant others, does the 
client report? Are there any additional 
cultural, ethnic, or religious variables 
to be considered? 

Previous Acces s To Social Services 
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Andrew (1973) found that the initial 
inierview is the hardest part of our 
task, the part that demands from us the 
most ' intensive concentration. An intake 
interview as suggested in this paper may 
require additional time initially, but is 
an efficient use of time when it comes to 
eliminating unnecessary work sample and 
psychome t ric test administration. 

1 NDTVTDUAl.T/.ED VOCATIONAL RVALU ATT 0N_ PLAN 
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Hasselt and Hersen 
d the current research by 
he "mo s t p r omi s ing 
sessi?ient appear to be 
observations of 
f the first o b s t> r V a t: i o ti s 
n makoduring the intake 
observe basic, worker 
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he ability to recall 
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Couch and KroiMuan ( 1 9 7 TO s I a I c d i Ij a I 
the unique communication and knowledge 
r cqu i roinen t s associated with deafness 
require mo d i f i c a t i o n s in i ns t rume n t a l ion , 
techniques, methodologies, but the goals 
and objectives of vocational evaluation 
remain the same as w i t li other ciionl 
groups. Tho goals for the vocational 
evaluation are: 1) determiningthe 
c\ i o n I ' .s p o I 0 n I I a 1 lor r o h a h i I i l a I Ion, 
2) i d c M t i I y i n g the assets o i an 
individual, 3) identifying the specific 
problems "interfering with the client's 
rehabilitation, 6) ascertaining a 
vocational direction, and 5) developing a 
recommended plan of action. Peterson, 
Capps and Moore (1986) highlighted five 
precautions with vocational evaluations 
of persons with visual impairments : 1 ) 
work samples developed for a limited 
range of jobs, 2) need for more attention 
to learning styles and needs of this 
population in work sample development, 3) 
lack of works samples focused on training 
program requirements, 6) inadequate 
analysis of visual job demands and 
possible job modifications, and 5) need 
for reliability and validity studies on 
current work samples. 
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Upon completion ol t li c» IVU 
instruments, modifications, and 
adaptative devices should be designated. 
Careful selection of evaluation tools is 
necessary. The majority of psychometric 
tests and work samples are not 
appropriate to use when only administered 
in the standardized manner. Botterbush 
and Michael (1985) summari/.ed this 
d i 1 emma . 

When the evaluator tests persons 
different from the group(s) the test 
was designed for and normed on, the 
problems iri obtaining accurate 
results increase in both number and 
complexity. The instructions, item 
format and content, methods for 
answering items, and many ot!*, er 
specifications make a particular 
test useful for specific 
popu 1 at ion ( s ) . Changing the 
population of test users often 
requires c h a n g i n j^, the lest 
procedures or locating a test 
specifically designed f o [ a 
particular group of disabled 
persons, Thufi, cva lua tors must he 
willing to select appropriate tests 
and/or modify these tests to meet 
I. he different needs of various 
handicapped groups, (p. 16) 
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UKHABILITATION ASSESSMENT AND TREATMENT 
OF THE LOW BACK-INJURED PATIENT WITH CHRONIC PAIN 



Koii.'ild .1. Spi l/.n.i/;(.'l , Kd.l)., CKC, CVK 
Cinny Linder, M.H.S. , CKC 



Abstract 

Chronic pain occurs in approximately 8 out of 10 
people. Many of those who suffer ftoin chronic 
pain have that pain localized in the low back. 
Chronic low back pain (CLDP) is one of the lead- 
ing causes of lost workdays and it has become 
excassively expensive to evaluate and treat. 
Traditional medical approaches do not appear to 
have attained results needed by the patient. 
Other so— called complementary health care mod- 
alities have been introduced including the pain 
treatment center (program) . Such a program has 
been initiated at the University of Florida's 
Health Center Complex within the last 18 months. 
It is a multidisclplinary approach. Prelim- 
inary results indicate some positive trends in 
outcomes, such as return-to-work. 



In troduction 

Chronic pain, especially that chronicity asso- 
L'iatod with low back pain (LHP) » is ;i phenomenon 
which has become a major health problem. While not 
life-threatening, chronic low back pain (CLBP) has 
a detrimental effect on the quality of life for the 
individuals themselves, their families, and society 
in general. As more cases are evaluated and 
treated, especially through pain programs, the more 
is learned about CLBP. 

Incidence of CLBP has been thoroughly reported 
by governmental agencies, e.g., National Institute 
of Health (Nachemson, 1976). Approximately 80% of 
the population will suffer from CLBP during their 
lifetime. Not only will this 80% suffer from the 
condition, but it will be severe enough to impact 
adversely upon their activities of daily living 
and/or will require medical attention of some form. 
Chronic low back pain is said to be a major cause 
of workdays lose, e.g., 1,400 workuays per 1,000 
popniation in the United States and 2,600 days per 
1,000 ill (.TiMl lirit.iiii (Acldi.-wuu MJM'i; IJ.'Ikiu, 

1982) . Next to alcoholism, CLBP ranks as the 
second mo'^c frequent reason for being absent from 
work. CLtlP i.j certainly a most e):pensive medical 
problem i Smith & Crisler, 1985), with estimates 
reaching as high as ninety billion dollars spent/ 
lost per year (Bonica, 1981, Aronoff & Rutrick, 

1983) . In the age group 30 to 60, this problem is 
most costly, both in terms of dollars spent to 
alleviate the pain and in amounts lost in workdays, 
contracts and so on. Two hundred thousand sur- 
geries are performed annually for treatment of 
CLBP, along with more than nineteen million doctor 
visits (Brody, 1982). 
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Medical scien(!e presents ac ite pain and 
chronic pain. A distinction must be made between 
the two. The former has been variously described 
as time-limited or recent -on set pain '[Fordyce , 
1981). Acute pain is generally an inaieator to 
notify the patient of a particular problem which 
requires treatment. Clironlc pain, on the other 
hand, has the property oi being ctuhiring in cluir- 
acter, i.e., six months or more. Present in 
chronic pain are factors forming a complex inter- 
action emanating from the physical realm (biologi- 
cal and physiological;, environmental (socioecono- 
Ti\ic) conditions, and psychological (learned goal- 
directed behavior and/or conditioning) components. 
The detinitions of chronic pain and by inference, 
CLR. , imply that the patient will need more than 
the usual treatment afforded by the medical model. 
The traditional medical model dictates that treat- 
ment of the patient be focused discovering and 
nllevialing the «( urce of the nociceptive stimula- 
tion (Aronoff, 19H1). The whole life (social, 
psychological, vocational) of the patient is gener- 



o ■ 

ERLC 



170 



182 



NATIONAL FORUM 



ally net considered, not out of lack of concern, 
but due to the nature of the situation. A patient 
with CLBP who enlists the help of professionals 
is in need of more than medical treatment. 

The following characteristics are jften ob- 
served in patients with CAM: a preoccu^)ation 
with pain, blaming others for one^s own diffi- 
culty, suspicion and anger towards others, strong 
and ambiVvalent dependency needs, passivity (in- 

rd turning) , use of pain as a symbolic means of 
communication, depression, lack of insight, maso- 
chism, denial of situational reality, anxiety, 
bitterness against others who enjoy pain-free 
life, feelings of isolation and loneliness, in- 
ability to deal with repressed anger and hostil- 
ity appropriately, poor judgment, attempts to 
control and manipulate others, hopelessness, anx- 
iety, lack of critical decision-making, inability 
to cope with stress, inability to meet the acti- 
vities of daily living, low frustration/ tolerance 
levels, denial of situational reality, sense u£ 
indignation and injustice, and compensation 
neurosis. And the list does go on. (Beck, 1985: 
Aronoff & Evans, 1985; Hollingsworth & Watson, 
1980; Stcrnbach et al, 1973). 

Traditional medical management of CLBP in- 
cluded bedrest, surgery, nerve blocks, TENS, medi- 
cations of varying potency, and physical therapy. 
These are the modalities most often mentioned by 
the patients. Due to the nature of CLIM\ these 
intcrventivc modalities hnvc brought about v.iry- 
ing levels of success. 

Non-medical healing modalities have also been 
attempted when the individual patient believed 
traditional approaches proved unauccessful . Ko- 
tarbn (1983) indicates these non-medical health 
care services can be best conceived of aa comple- 
mentary health care modalities (CHCM) . The use 
of one or more of hese services is situational 
in that the patients who use the^ still very much 
believe in the efficacy of conventional medicine, 
but are pursuing other resolutions to attain 
specified goals* 

One CHCM, chiropractic encounter, has the 
greatest following of all non-medical health care 
services (Kotarba, 1983). Another CHCM, which 
Kotarba (1983) designates as the applied mystic- 
iom approach, includes meditation (TM, yogu), 
biofeedback, self-actualization, acupuncture, 
and hypnosis. Still another CHCM is the chronic, 
pain center. This is the focus of our discussion. 

No one of the above modal :f. t i cg , whether con- 
ventional/traditional or tli^ tHCM may be the best 
approach to CLBP. There is no consensus among 
the various professional groups as to wh/ch stra- 
tegies are most effective in treating CLBP so the 
patient can reclaim an appropriate lifestyle, in- 
cluding return to competitive employment. The 
chronic pain center appears to have subsumed many 
aspects of the various modalities alrecidy men- 
tioned. It could be considered a plausible avenue 
fo ' the CLBP patient. 

The G_en^rjl^ain_Pro 

In 1961, Dr. John Ronica, an anesthesioio- 
gist, conceived and developed the fin^L multi- 
disciplinary pain treatment center in the state of 
Washington. Today, thert are more than 800 



chronic pain cenr.era in the United States, some of 
which are un i-d isc i pV innry . rntlMv than multi- 
disciplinary. The emphasis in this article will 
be on the latter (Hendler & Fenton, 1986). 

The membevi? of the multidiseiplinary team in 
a pnin treatment centc could include a neurolo- 
gist, a neurosurgeon, ..n orthopedic surgeon, a 
psychiatrist, a dentist, a radiologist, an optha- 
mologist, an otolaryngologist, a pharmacologist, 
a social worker, a psychiatric nurse, a psycholo- 
gist, a physical therapist, an internist, an occu- 
pational therapist, a vocational evaluator, a 
vocational rehabilitation counst'or and/or a re- 
habilitation specialist, and a nutritionist/dieti- 
tian technician. This list is certainly not in- 
clusive. The patient should always be considered 
pirt of the team. The individual patient's needs 
will dictate additional consultants being added to 
the above list. Family members would be an im- 
portant team member due to the critical knowledge 
they possess of the patient and the post-pain- 
treatment care which they will provide for the 
patient . 

In general, the mission statement of a pain 
treatment center might be to assist indi' iduals in 
re rning to a productive, functional lifestyle 

_ough treatment and manag*. uent of pain. A goal 
of a pain center would be to aid patients to apply 
values and techniques learned during their stay to 
activities of daily living after dlschcir}\e. Treat- 
ment modalities in a pain center might iuelude 
surgery, group and/or individual therapy (stress 
management, relaxation, behavior modification), 
nerve blocks, TENS, evaluation of home situation, 
physical capacity evaluation and physical therapy, 
work tolerance screening and work Uardening/si tn- 
ational assessment, vocational evaluation, voca- 
tional rehabilitation (job readiness curriculum), 
recreational therapy, medication, and dietary regi- 
men* 

The team members assemble on a scheduled 
basis, e.g., twice weekly, to discuss individual 
patient's progress. Deletion of, or addition to, 
the treatment plan would be made at this time. The 
team increases its effectiveness when crossover of 
ideas between disciplines is viewed as helpful lo 
the patient. This cross fertilization of Ideas and 
knowledge can be quite benericlai to aJ I involved 
(Newman & Seres, 1986). 

Aronoff, Kvans and Enders (1983) completed a 
study of twenty multi-^disclplinary pain-unitH. 
Their research showed a wide ran^c of activities 
with little allowable comparisons due to muT iple 
factor^.. In order to make comparisons, certain 
standardizations have to be met. Some advance in 
this direction has been realised recently. rhe 
Commission on Accreditation of Rehabilitation 
Facilities (CARF) has started the accrediting pro- 
Cf ss for chronic pain management pro[;rams, with 
fifty being accredited by mid-'1986 (Rothberg, 
Simons & Spencer, 1987). Other def iciencie.s noted 
by Aronoff et al . (1983) included length of follow- 
up, using memcry of events rather than actual time 
measurement, lack of face-to-face afi.q'\'5sment in 
lieu of questionnaires. 

SpJ-n, 1 1 I't ec^^JTiien t_ and A'^i^^l.yi^-.lfJL^.i^.PJlilB^^^^ 

line to the epidemic proportion of CLBP indi- 
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vlduals who constantly seek respite from tliia 
aggravating and frustrating problem, profession- 
in the teaching clinics at the University of 
Florida's teaching hospital attempted several 
times to establish a pain management prograir. 

Their combined efforts culminated with a 
series of meetings in October, 1987. The scheme 
of this attempt was to focus on low back pain 
rather than chronic pain in general. It would be 
concerned chiefly with the musculoakeletal reha- 
bilitation of the spine. The program would be 
limited to individuals who were receiving work- 
ers' compensation. Thus, the Spinal Treatment 
and Rehabilitation (STAR) program had its start, 

The program would involve both extensive 
evaluation followed up by a six-week program of 
treatment. The mtjltidisciplinary team approach 
was established. Members of the team included a 
psychologist, an occupational therapist, a voca- 
tional rehabilitation counselor/evaluator , a 
physical therapist, an orthopaedist, a pharma- 
cist, and a nutritionist. Other disciplines 
such as psychiatry, communicative disorders, 
internal medicine and dentistry, are consulted 
when the occasion demands. 

Initially, the patients were evaluated over 
a period of three days to one week in the various 
disciplines. Recommendations are made by the 
team to the insurance carriers regarding the 
suitability of the patient for the treatment 
phase of STAR, Often, the time lug between eval- 
uation, team approval, insurance approval and 
stait of program extended to a half-yet r. This 
lengthy wait was deemed impractical and poten- 
tially disruptive to the patient. Currently, 
evaluations take plai^ at the outset of the STAR 
program. Patients are initially screened as to 
potential and ultimately accepted after evalu- 
ations and team decision. 

The STAR program extends for a period of six 
weeks. Emphasis appears to be placed upon phys- 
ical reconditioning, since the mornings of each 
treatment day are devoted to this* 7\\e MedX 
machine and other Nautilus equipment are used for 
the demonstration and practical parts. The pa- 
tients are given much information regarding edu- 
cation on the back, i.e., how it works and body 
mechanics. Lifting techniques are stressed, in 
addition to endurance (by walking programs), 
flexibility (by stretching exercises) and by 
strengthening (through the Nautilus equipment). 
Afternoons .iro dJvidc'd among psychology (pnin 
management, stress management, biofeedback, relax- 
ation techniques) , occupational therapy (work 
hardening) and vocational rehabilitation. 

The cost of the STAR program Is consistent 
with other pain centers, and eoraewhat in line 
with alcohol and drug rehabilitation centers. 
The extensive eval'iailon cost Js currently $2,000 
with the treatment nhase at $10,000. 

A STAR team m'^ttJng is held twice a week to 
discuss each patient in Lurn» The clinical p«y- 
choloj'^ist leads the treatment phase. Probli'ms 
are discussed and each mamber of the team offers 
suggestions or insi^hta. 

The initial ?.viluntion of a patient for the 
:TAR program was in December 1987, with the first 
rroup beginning; .in March 1988. To datr. , 8lx 
groups with two no eight participanxa have parti- 



cipated in the program. A total of 46 patients 
havo completed tho evaluation process. Of tlicsi.s 
25 (56, &X) have continued on in treatment. Of * 
these 25, 19 have completed the program. While 
the total number of the patients involved in the 
STAR program does not lend itself to comparisons, 
certain demographic data is given for consider- 
ation . 

STAR Demoi^raphicB The overall profile of a STAR 
patient would suggest almost a middle-aged (38.8 
yaars) male, who is Caucasian, with a lower mlddJc 
class income. The typical evaluee would have 
experienced approximately 2-1/2 years of chronic 
pain, would likely be married, and would have 
completed the tenth grade. This evaluee would not 
have been employed at the time of evaluation. 
Morf^ than likely, an attorney would have been re- 
tained. 

Lifting appeared to be the major cause of the 
CLBP, with surgery to relieve the symptoms being a 
very real poasibility. Drugs for pain would in 
all likelihood be part of the daily regimen. 

Since the program is recent in start-up, 
follow-up, which is an Integral part of the entire 
process, has just begun. Follow-up is offered at 
three levels: (a) Individual appointments (psy- 
chological, vocational, etc.) are available with 
team members as needed and practical; (b) the 
physical therapy staff offers supervision and 
access to the equipment post-program, or a pre- 
scription to a similar facility is written; and, 
(c) invitations for face-to-face follow-up with 
the team is planned every six months. The first 
of these follow-up clinics was conducted in Febru- 
ary 1989, less than one year after the first treat- 
ment group started. 

Follow-up ir considered a critical element in 
any program. In the STAR program, follow-up is 
just beginning. It is scheduled as an integral 
portion of the STAR program. 

The meager follow-up data obtained to date 
does not allow for specific comparisons with other 
pain centers. Many of the participants in the Feb- 
ruary 1989 follow-up had only completed the program 
lesc than five months agn. The fact that 38 per- 
cent of the STAR compietoro have attained some 
employment or training is most reassuring, and is 
a motivator for- continuing. 

yocatiorial Eya^ 1 ua t i o n 

The vocational rdiabilitation evaluation com- 
ponent of STAR is somewhat unique since many of the 
multidisciplinary teain.y did not include this com- 
ponent. It is true that many of t.Me programs con- 
tained the occupational therapv^ element. Emphasis, 
how«ver, on the mechanJca of the vocational assess- 
ment process, c.nreer exploration, and issisting the 
client in seeking competitive employment are seri- 
ously lacking. 

This component in the STAU progmm begins in 
the evaluative phase. A cjiagno:jnic initial jnter- 
view obtaXnb pertinent medic/^l, social, educational 
and work history, they will impact upon future 
emploync?nt con -Iderations . 

Ttie evaluation plan incluctf:<5: interests, 
aptitudes, achievement, (work) values, oersonlllty 
(temperaments) and intellectual functioning. The 
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choice of instruments administered dapeiuls on thu 
individual client. The Apticom, S.A.C.E., VALPAK, 
T.A.r. Hystems nro .•]J1. availnblc. I)c*xttTity 
tests, such as the liennett Hand Tool, CrawCord 
Small Parts, Purdue Pegboard, and so on, can be 
accessed. Paper/pencil tests available include 
Career Occupational Preference System, Strong 
Inventories, Self-Directed Search, Career Deci- 
sion Making System, Career Assessment Inventory, 
WRIDT, Reading-Free Interest Inventory, WRAT-R, 
C-CAT, Test of Adult Basic Education, Revised 
Beta II, and the TONi. 

The client has access to the CHOICES System 
and the Florida VIEW System, both cf which are 
computerized career exploration programs. Each 
uses various worker traits and other data to help 
the client decide what to select aa options for 
future competitive employment. Also available 
for ansistance is the Occupational Access System 
(OASYS) . This last system is used in developing 
the residual functional capacity, i.e., trans- 
ferability to current level of functioning. 

A rehabilitation assessment report is com- 
pleted following a format which includes the 
usual information on the client with results of 
the testing and observations. Transferability of 
skills is addressed, along with specific recom- 
mcMulatlons regarding anything which miglit impact 
adversely upon the client ^s future job placement. 

The treatment phase is conducted generally 
in a group setting, although individual work Js 
scheduled. Primary targets for this phase are 
career exploration and Job seeking skills. In 
the former, activities such as reviewing interest 
surveys, accessing the Occupational Outlook Hand 
Book , Guide for Occupational Exploration , com- 
puterized career search, and open discussions 
are all used, but by no means limited to these. 
The job seeking skills phase instructs the indi- 
vidual on how to fill out an application, obtain- 
ing an interview and practicing interviewing. 
Videotaping and role-playing are key factors in 
the interviewing process. 

Information on Florida's Worker's Compen- 
sation (WC) laws and procedures is elso given 
prominence. The local WC Bureau rehabilitation 
nurse is invited to speak to the group and answer 
questions. Coordination with each client's 
rehabilitation specialist is emphasized, along 
with visits and review of the client's progress. 
The .-licnl is nrj'ccl to i-onlMcL .H\y of those pro- 
IcssioiuiLs 11 where arc tmcstions or problems. 

Conclusion 

The chronic low back pain patient is seem- 
ingly everywhere. Traditional, conventional 
modalities have met with mixed success when treat- 
ing the Clh? patient. Complementary Health Care 
Modalities, especially the pain clinic, are also 
meeting with mixed success. The pain clinic, 
however, seems to be working out better overall 
for the CLBF patient. The reason for t lis could 
be the wul t idisciplina ry approach whifi is common 
to most pain clinics (McArthur, Cohen, (.ottlieb, 
Naliboffi, Schandler, 1987). It Is this approach 
which the STAR program has fostered. 
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SITUATIONAL ASSESSMENT IN AN INTEGRATED SETTING FOR SURVIVORS OF TRAUMATIC 



URAIN INJURY 
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CHARLOTTE REHABILITATION HOSPITAL 



Abstract 

Situational Assessment In an Integrated hospital 
or community setting provides valuable work 
opportunities and feedback about work readiness 
skills In the vocational evaluation of survivors 
of Traumatic Brain Injury (TBI). Assessment 
opportunities wcro developed ;mcl urlMzerl 
during the screening phase of referrals for a 
job coach Supported Employment Program. 
Charlotte Rehabilitation Hospital in Charlotte. 
N.C. received an OSERS Part C grant from the 
N.C. Division of Vocational Rehabilitation in 
April, 1988 to establish and demonstrate the 
effectiveness of this model of Supported 
Employment with TBI survivors. A full-time 
Community Re^-Entry Specialist and half-time 
Job Coach were hired for one year with a goal 
of placing eight to twelve individuals in a 
competitive job at least 20 hours per week in an 
Integrated setting with support. However, 
traditional vocational evaluation in a clinical 
setting and review of other psychological or 
neuropsychological evaluations and knowledge 
of transferable skills or previous work 
experience did not give adequate inforra^tign to 
determine which of the more than sixty referrals 
received were most work ready or adjusted to 
their disability. Lack of insight Into deficit 
areas and aiemories of pre-^injury vocational or 
educational status interfered in that adjustment. 
The intended outcomes of utilizing the 
situational assessment are to increase self- 
awareness for the individual of strengths and 
limitations and to assist in developing /o-ilistic 
and appropriate goals with n plan of action and 
periodic re-evaluation to modify goals. The 
existing structure for other hospital volunteers 
was utilized and all referrals who did not have 
an appropriate job or specific goal were offered 
work opportunities. Negotiation between some 
referrals and their previous work site and the 
Supported Employment Project staff developed 
situational assessment work opportunities at 
former job sites with job coach support, when 
situational assessment placements have not been 
good job matfthes, the individuals have the 
benefit of Supported failure and feedback to 
set more realistic goals and minimize damage to 
self-esteem, work record and work reputation. 
Project staff have been s resource to on-site 
supervisors or co-workers after tne job match 
to provide education, teach compensatory 
strategies, collect performance data nnd provide 
feedback compared to non-handicapped worl s 
in .m inLo)>raLcHl work soLtLni;. 



The Increased stress and psychological 
adjustment which follow any traumatic event are 
compounded by deficits in physical, cognitive, 
behavior or psycho-social areas, changes in 
personality and family roles and altered status 
or vocational or educational potential when the 
traumatic event is n brain injury. Tlio life 
problems that emerge following TBI persist for 
months and years beyond the acute phase of medical 
care. Recovery may span a decade from date of 
injury and still the person may not be exactly 
the same as before the brain injury. Psychologi- 
cal issues may never be fully resolved. 

The individual with TBI may feel like a 
different person. Suddenly there are memory 
problems, fatlque, slow mental processing, loss 
of coordination for some tasks and increased 
frustration. There is loss of independence and 
loss of control and perhaps a need for continued 
therapy, re-training, counseling and evaluation 
for months and years. Eventual outcome is 
difficult to predict. Situational Assessment 
can offer work opportunities and valuable feedback 
on performance, work habits, social skills, 
behavior and initiative, in the evaluation process. 

Traumatic Brain Inju ry 

Whether a TBI is classified as mild, moderate 
or severe, persistent deficits may continue to 
interfere with everyday Life, Impaired executive 
functioning may affect: 

Self-awareness of strengths and limitations 
Appropriate or realisf:lc goal setting 
Planning and Organizing 
Self initiating or self Inhibiting 
Self monitoring 
Self evaluation 
"Traumatic brain injury is in some ways a 
diffuse injury, and leads to the disruption of 
multiple aspects of the cognitive systems, 
including attention, language, higher cortical 
functions, social behavior and personality and, 
of course, memory, to mention a few," (Trexler and 
Zappala. 1988). Cognitive, behavioral, emotional 
and physical consequences create problems in 
returning to productive roles in the community, 
whether as student, trainee, volunteer, homemaker, 
or paid employee, with lifetime support needs, nnd 
continuing adjustment I'^ues during recovery. 

Recovery usually .avolves a continuum of 
services after initial oni.et of TBI, dependinp 
on the severity nnd availability of appropriate 
sorvicos. nnd may inclndc Trnunin cnre, Acuto rnrr 
Com,! rnrts AruLc Rchabll itnLion . Long Term Rehabi- 
litation, Regular Out Patient or Out Patient Day 
Treatment or Community Re-entry Services. There 
is no typical or nonnnl brain injury ,so each THl 
must be indi 'idiial ly evnlnnted, treated and en- 
couraged to become involved in their rccoverv. 
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Why Situational Assesstient ? 

In the screening process for establishing 
need for Supported Employment job coac and 
long term support, test results and previous 
work skills and academic abilities do not give 
the whole picture. The vocational evaluation 
process can utilize situational assessment to 
assess motivation, Initiative, dependability, 
ability to structure time, accept supervision, 
or learn new information. Work behaviors can 
be assessed in a real work setting, using work 
trials. ( Ben-Yishay et al., 1987) 

Situational Assessment can provide work 
opportunities even before the individual is 
medically released to return to a previous Job 
and can help set realistic goals. Sometimes it 
is preferable to have the situational assessment 
away from the previous work site. In the case 
of K.C., a 29 yr. old female with a training 
position as finimcinl consultant/stock broker, 
a setting away from her firm was acceptable to 
her. She did not want to be seen by co-workers 
doing filing and other diminished aspects of her 
job because she feared it would affect her status 
in the office hierarchy. A situational assess- 
ment in the hospital allowed her to gain feedback 
and improve on skills necessary for success when 
she returned to work. K,C. had suffered a hear- 
ing loss and slower auiiitory comprehension with 
her brain injury from a car accident approximate- 
ly two years ago. Her volunteer job was to call 
past volunteers to thank them for their help and 
ask if they want to continue to volunteer. This 
helped practice the calls she would eventually 
make to offer her sex vices as broker or explain 
a certain stock package. Opportunities Lo give 
oral presentations on financial planning were 
arranged with feedback. As she progrefised, she 
assisted in a political campagign as a volunteer 
to improve her ability to use the telephone as a 
sales tool. She maintained a schedule which 
included exercise in the Health Fitness Program 
at the rehabilitation hospital and situational 
assessment in several hospital departments such 
as oat-patient Physical Therapy, Vocational 
Services and working for the Volunteer Director. 
K.C. took one or two courses at local colleges 
each quarter in the last six months before 
resuming her old trainee position, full-time, 
with Job coach services. She had received full 
vocational, psychological and neuro-psychological 
and auditory evaluations as well as Physical and 
Occupational Therapy and continued Speech Therapy. 
Work adjustment and psychological support were 
offered through group and individual sessions 
dealing with managing stress, re-gaining self- 
confidence and assertiveness and resuming driving 
an automobile. Information from her situational 
assessment made the transition to work easier. 

Sometimes n person cnn return tn work too 
sdon .Mul lose .M Job or |M)HlLlon because they 
fire not ready to handle the duties or responai- 
bilities. Take the case of T.B., a 38 yr. old 
male with 18 years experience in auto body repair 
and estimating. He had a motor vehicle accident 
in May of 1987 and returned to his former job 
against the advice of his out-patient Occupation- 
al Therapist and Vocational Evaluator in Sept. of 



the same year, just four months after his injury. 
He had a vocational evaluation and prevocational 
group evaluation and was referred to Vocational 
Rehabilitation. He reported no problems to his 
doctor and was released for full-time work in 
November of 1987 and soon was terminated from his 
job by his employer. No job coach services were 
available at that time and he did not participate 
in situational assessment to evaluate work related 
skills. T.B. had lost vision in his right eye and 
enjoyed limited use of his left hand and shoulder 
His employer stated the following reasons for 
letting T.B. go after 18 years; poor reasoning 
skills (he went into the. boss'; wife's office and 
sat down and told her all about how he used to 
do cocaine), poor concentration (he did not stay 
on any task for very long), poor initiation and 
follow through, taking two hour lunches (T.B. s.iid 
it took him lonRcr to o.it now), ndt rollowLnj; 
policy (not signing oot when leave for doctor's 
appointment), not follow employer instructions 
(refused to put green sticker on to show he had 
inspected vehicle) and generally not being 
productive for the company. In completing an 
estimate, he may be accurate on all except that 
he would not include o broken mirror or other 
detail by oversight. or lack of attention to detail. 
Later a community college class was recommended on 
Estimating Auto Damage and T.B. agreed to resume 
therapy and psychological counseling. Agitation, 
violence and low frustration tolerance were common 
which resulted in marital discord. T.B. lost a 
good job due to lack of insight of problem areas. 

A person may not be ready to return to work 
responsibilities of a subs tnn tl<il , ^'^nlnful nature 
because of many reasons. Fach individual passes 
through stages in the recovery and improvement is 
expected to continue for years. 

Unpredictable Performance 

Emotional mood swings and loss of control can 
contribute to unpredictable performance. Loss of 
initiative and lack of Insight and awareness of 
deficits can prevent a person from benefiting 
from feedback. Memory deficits create problems 
for the person to remember what is expected or 
how he did the task yesterday. Medication side 
effects can affect performance and work speed. 
A person recovering after a brain injury may make 
progress in stages and have plateaus in progress 
during which relatively little progress is made or 
even function may be lost. Structure, repetition 
and consistency are important elements to achieve 
more stable performance. Behavior management 
programs and drug /alcohol education programs may 
be needed. 

Psychological Adjustment Issues 

Activities which were once s.otlsfyiJM' her.iiise 
they HKiLcheil previous MhlliLies or were natural 
or automatic may not be satisfying if they are 
now difficult and frustrating to perform. There 
are almost always changes in personality. Fraser 
et al, (1988) state, "head injured persons who 
continue to experience memory deficits, problem- 
solving difficulties, mental inflexibility, and 
lack of insight into their limitations may lose 
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several Jobs without clearly knowing the reasons." 
Loss of confidence and self-esteem result from 
pursuing unrealistic gonls. Individuals must 
learn to manage Increased stress and deal with 
dependency Issues, situational assessment can 
offer opportunities for success if a job is 
matched to current ability and cognition level. 
Tlie person is aware that responsibilities will 
be increased as function improvos . After TBI, a 
person needs to be vigorously challenged and' 

^° ^P'^'^ve functional skills. (Chance, 

1986) 

"Tlio demands of ,i cdmpcL 1 Live job arc 
significantly greater than ihoac found in most 
rehabilitation facilities and are almost a 
quantum leap for many head-injured clients 
However, many head-injured clients can make the 
transition if it occurs slowly. For example, 
placing a head-injured client in a volunteer 
position on a part-time basis, gradually trans- 
ferring the client to a part-time job and 
untimately a full-time job. all under the direc- 
tion of a coOTiunity reentry specialist, is one 
nethod that could be used." (Fawber & Wachter, 
1987). It is a big step from a rehabilitation 
tacility to community re-entry to home or work. 
Lyons anu Morse recommend a "gradual, progres- 
sive transition from a medical setting to work 
placement and community reentry." (I988). Work 
trials within the hospital and supervised place- 
ments in the community were included in their 
•Iherapeutic Work Program for Head-Injured Adults. 
Gradually adding developmentally appropriate 
tasks and expectations and providing feedback to 
be used to modify goals help give a sense of 
control to the survivor of TBI. The individual 
iiec'c c:lu)ices and involvement in planning process. 

Group support meetings were held to provide 
education and allow exploration of negative 
psychological reactions to disability. Members 
of the group were able to learn from each other 
and see the impact their behavior has on others. 
The group meetings were held one evening per 
week for three hours for ten sesBions. TVrelve 
individuals at a time were invited to participate 
to share observations on their situational 
assessment or supported work placement. Monthly 
follow-up support meetings* provide long term 
psychological support to the individuals who will 
be dealing with adjusting to their traumatic 
brain injury and resulting deficits for many 
years. 

S tamina and Endu r ance and Work S£eed 

Often after TBI, physical and mental speed 
is decreased by slower processing and reaction 
time. It takes more effort to accomplish less. 
A slower work speed is common which could affect 
production standards, reading or study time, task 
completion and fnistrntlon Colernnrc. It l« not 
.1 Kood idea to ruturn Lo work or school y.vf.n-.u 
work speed and endurance meet at least entry-level 
expectations or minimal demands of work setting. 

Need for Continued Therapy/ Education /Recr eation 

Since the healing or recovery process ran 
continue for years, individual or group therapy 



may be beneficial. Situational As.sesanent can 
be scheduled along with oi,t-pntient therapy, 
clu.S8es or Icisurp. activities as pan of the 
evaluation and rehabilitation process. Education 
and training classes can be used to gain feedback 
on ability for new learning, to review previously 
learned material where memory problems exist and 
to increase skills or coordination in a certain 
area. Recreational activities can be therapeutic 
and provide opportunities for socialization. 

One. referral to the Supported Eniploymenr 
Project participated in a combination of therapy 
;ind sitn.ition.n1 assessmcMiL. L.|{. is ,1 1 7 y,- ,,1,1 
iemale with a TlJl received in a car accident' «cven 
years earlier when a drunk driver struck her car 
which resulted in the death of L.B.'s mother. She 
was raisad by her father who noted changes in her 
academic performance, personality, judgement and 
physical appearance since the accident. No ser- 
vices were available at the timr> of the accident. 
Public school could no longer meet her needs due 
to learning disabilities in reasoning and 
attention deficits, social disinhibition and lack 
ot insight She was between her junior and senior 
years of school at a special high-priced private 
academy for learning disabled children, insurance 
coverage assigned her problems to psychological 
rather than neurological origin -nd refused to 
cover most services which were noi; available. For 
six weeks during the summer, L.B. participated 
in a daily schedule cf /jitunrd.onal assessment and 
individual and group therapy as follows: 

8:30- 9:00 Check in OT-set daily goals /review 

pertsonnT grooming and preparation 
9:00-9:30 Individual Psychology (therapy) 
9 :30-10 !30Exercise-Health Fitness Program 
10:30-11 :30Sltuatlonul Assessment 

Voc. Services clerical aide 
U : 30-12 :OOLunch (with Voc. Services staff in 

cafeteria ) 
I2i00- 1:00 Situational Assessment 

Cafeteria aide 
1:00-2:00 Jituational Assessment 

Transportation Aide 
l''2.?:'^'-°Jl Adjustment to Disability Group therapy 
3:00-4:00 Situational Assessment 

Cafeteria Aide 
4:00-4:30 Vocation 1 Services (evaluation) 
4:30-5:30 Social Skills II (2 days per week) 
Indapendenir Living Skills (3 days) 
(group therapy Included outings in 
the community to practice skills) 
L.B. continued the Situational Assessment in the 
afternoon when school resumed in the fall. Se]f- 
monltorlng check-lists were developed to doa'l 
with grooming and hygiene problems, close super- 
vision needs emerged as L.B. inappropriately «aw 
every male as cute and interested in her. she 
talked to a patient in the hospital with a brain 
injury who was more than 2 0 years older than her 
dunni; her lunch periods Hnmeiimcs hut. reported 

MJ''V'l,r\ ""'^ Solnf^ to marry 

him... Feedback on the impact of social inter- 
actions were provided to reduce impulsive actions 
and regulate verbal output and excessive talking 
FVentually a supported employment plncement was 
made as cashier at a large toy store with iob 
coach services. Information gained from th.; 
situational assessment helped in this placement. 
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Each individual will have special needs 
;in(i s iLu.iL it>nal assessmonl and v(H:/it loniil 
cvaiujiLion need lo be flexible . Another reCerral 
for Supported Employment Services is S.M, , a 27 
yr. old male receiving Workman's Compensation 
for a work-related injury. The job he wants to 
return to is sales representative for a major 
supplier of sophisticated office equipment, Some 
problem areas stUl limiting him included fatigue, 
reduced reasoning, slower mrntal processing time, 
lack of self-confidence nnd v^^oblem solving 
abillu^, reduci-d assort Lveness, and lowered 
f rustlv.t:.on tolerance. His company a growing 
and aggressive company and would like S.M. to be 
back at 100% before resuming his full duties. 
His supervisor is willing for S.M. to have a 
scbeduled'bituational assessment for eight hours 
per week at hU previous work site with support 
I rom Project job coach. He participates in 
training opportunities to review Bales presen- 
tations, accompanies other sales representatives 
on calls, and on-the-job training in assertive- 
ness and sales techniques from his supervisor. 
Recommendations were made to move his desk to 
a less distracting area and increase his organi- 
zation of his desk supplies. When he returns to 
work, he niay have his territory changed from a 
residential territory where he was on his own 
with a lot of independence and not much structure 
to a territory closer to the central office with 
more opportunity for supervision and structure. 
He may start out on a salary to take the stress 
and pressure off of coiratiission sales. His 
situational assessmenu at the Job site is 
combined with a snhedyle of therapy (Vocational 
Evaluation, cognitive fe- training, Problem- 
Solving group, individual Occupational Therapy) 
Exercise in the Health Fitness Program and 
Situation Assessment in the hospital in two areas 
(clrrical support for Nurse ^s station and 
supervising others in cognitive retraining) and 
he is taking a Public Speaking ^coUcge class. 

Why Use an In tt.g rail ed Setting? 

Many of the referrals to our Supported 
Employment Project were being served or were 
being considered for work adjustment or for 
situational -assessment in local sheltered 
workshops wV.ch were currently sorvlng primarily 
other developmentally disabled populations, 'fhe 
status of disability after TBI is not stable. 
Brain function and efficiency are expected to 
improve. Individuals need to be challenged and 
stimulated and placed in environments with 
other workers where there are opportunities for 
socialization and ability to learn from others. 
A person may rise to the occasion to meet 
social expectations or work demands. Feedback 
un work perfomanro needs to be based mi 
comparison with non-dlsablcd workerf? wlio arc 
meetiiH\ company or ^K^incy standards. Kocdbark 
will not be accepted if compared to lower grouv • 

In an intej^rated work setting, there is 
real work and potential lor being hired if a 
jub becomes nvailMble, Supervisor feodh.ick and 
ri'fcronre U'ttcrs l>nvr more validity U'^m 
integrated work yettinK«« A person may not be 
motivate' due to depression or low stimulu.-, in 



an environment with other developmentally 
(lis.ibliHl workers w|hi have less ch.incf ol 
improving and more time to adjust to their 
disability status. 

iif. ^"ique from other Development Uisabilltics 

Recovery and improvement is expected to 
continue and adjustment issues are different for 
each individual. Jobs or placements which meet 
ability levels at one point in the recovery may 
be out-grown as the person improves functioning 
level and cognitive abilities. A new placement 
or job modification to add more challenging duties 
will be needed. Rather th^in seeking all entry 
level jobs, individuals may have had work 
expel icnce in a wide variety of skilled and highly 
technical or professional jobs. Previous work mny 
or may not be an advantage. (Kreuizer et al .MJaH) 
Referrals to our Supported Employment Project 
had been out of the competitive work force from 
eight months to eight years and some had no 
previous work experience. Those who had worked 
still had vocational goals to return to career 
fields such as: auto mechanic and body repair, 
computer programmer, attorney, president of own 
company, pharmacist, sales representative, brick 
layer, bank teller, financial consultant/stock 
broker, school teacher, credit manager, textile 
worker, machine operator, .'.ar salesperson, 
office equipment mechanic or plumber. Adjustment 
is difficult when a lower skilled job is necassary. 

After an injury to the brain, a person may 
remember premorbid status and maintain goals 
based on pre- injury ability, Pre-injury abilities 
and experiences are important, however time must 
be allowed for each person to become acquainted 
with how their abilities or work speed or thinking 
have been affected. It is important to provide 
each individual with an opportunity to be compared 
or obtain feedback from others si.milai to his 
pre-iojury peers or co-workers. Since lack of 
insight and self-awareness and denial of problems 
are so common after TBI, a situational assessment 
with another population or disability group more 
mentally handicapped or physically handicapped 
than the individual being evaluated perceives 
himself to be... may be interpreted as having no 
value or relevance to the individual. The feedback 
B.ust be based on meaningful experience, 

A TBI is often not obvious, it is a hidden 
disability in many cases. The person looks the 
same. Often it is difficult to asl. for help or 
realiv.e that help is needed. The person may he 
trying hard to adapt and lie "their old self" and 
some can bluff and put up a good front. Job coach 
services ind teaching interventions must be fit 
creatively into the work environment without 
casting doubt on the worker's competence. The job 
coach is a facilitator. (Nishet 6. Via);ner, 19RR) 

Individuals may not need a.'-: much hel p 1 ca rnin)\ 
job duties as they will ^a learniu); to control 
some behavicrs, getting along with co-work-rs, 
^supervisors and rules and regulations. Psycho- 
social adjustment «nd relationships could be 
in'ohlem areas. lobs that meet ability at one stn,,e 
may i^c tnit };rown. ^^ften a i)crso!i naisl work M 
U'ss(M' or diminished ci\\nM:Uy or is nol. .ibU- to 
utilize previous education or training r.I tcr JBl 
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ULi lizin R Existing VoluiUGer Structure 

Wlicn the Vocational Services Deparimenl: 
recognized the need for situational assessment 
in the vocational evaluation process, work 
opportunities within the rohabllitntion hospital 
were explored. Consultation with the hospital 
Administrator and Volunteer Director reached an 
agreement to use the existing volunteer system 
to orient and place our TBI survivors in real 
work settings. Department Heads were contacted 
to Ldenl'fy work sc'LLin^s nnd .snpo.rvi.sorb. 

The Supported Employment Project staff were 
established as referral and resource and support 
for «he situational assessment placements. In- 
formation 1.... pertinent evaluations relating to 
Vocational potential are shared with the 
Vohinteor Director to obtain a good job match. 
Before beginning a situational assessment, 
each volunteer worker receives an interview, 
fills out an application, has a tour of the 
hospital and sees an orientation video and 
lias a picture identification badge made which 
all hospital employees wear for security reajons. 
An individual schedule is developed and mutually 
agreed upon between the Volunteer Director. 
Project staff, work supervisor and most impor- 
tant, ^.he individual being evaluated. Family 
members are included in the planning process. 

Volunteer workers are entitled to a menl 
ticket worth $2.00 toward purchase of a meal if 
they work as much as 4 hours in a day. There 
is a Health Fitness Program of exercise equip- 
ment, aerobic exercise and education which 
TBI survivors in situational assessment at the 
hospital are encouraged to use at no charge. 
Volunteers sign in and record the:J.r hours and 
receive ; ^cognition for their service to rfxthers. 

Creating Situational Assessments for Individuals 

In the beginning. Department Heads had a 
hard time finding work which they felt could 
be done in a situational assessment. However, 
once a few successful placements were made and 
word spread around, other work opportunities 
were created. The on-site supervisors and c<:^ 
Workers began to realize the value and benefit 
of utilizing these workets. Placements were 
created in departments that had never utilized 
volunteer help. J,C. wns n pliarm^icist for a 
large drugstore chain before her TBI, and her 
long-range go ; 1 is to return to this career. A 
placement in the hospital pharmacy was developed 
and scheduled in between her out-patient therapy. 
Tasks within her ability were identified. 

R.W.is a .10 yr. old male who had no paid 
work experience since his TBI from c car ure^.ck 
when he was 14 years old. He completed h high 
school program with a homebound teacher. He was 
then placed in a local sheltered workshop serving 
primarily mentally retarded adults. R.W. did not 
llko this environment and problems were reported 
with his ability to accept constructive feedback. 
Impulsivity, low frustration tolerance, memory, 
.social skillf: and following rules, lie wa.s 
referred for supportf;!d e^lploym^^^^ services; with 
a Vocational goal of maintainancp h'0.per lin an 
apartment complex or cafeteria worker. K. V'. and 



his mother weic interviewed and vocational 
evriluation was rout iiuKHl throuj'h i.hc hospi t.il 
Vocational Services Department. A situational 
assessment was offered to R.W. and he accepted 
and promised to do his best. He wasn't thrilled 
with all aspects of the situation. He told one 
potential supervisor during an interview. "Don't 
woriy, lady, if you don't want me. I'm not that 
thril \ about the work anyway." He wasn't 
thri*' \ about not being able to wear blue jeans 
to w. or having to remove his baseball cnp when 
insitiL' the hospital. However he agreed lo follow 
hospital policy and expressed a strong desire to 
obtain a reil job which could help him move toward 
independent living. He knew this assessment could 
give him an opportunity to prove himself and get 
work experience and possibly a reference. R.W. 
could not meet all requirements for any available 
job within the Housekeeping Dept. or Cafeteria, 
but could perform certain tasks and duties with 
adequate supervision and prompting. A modified 
job description was developed for his situational 
assessment which tuok ta^^ks from two departments 
which allowed paid staff :o spend more time on 
other duries. In the Housekeeping Department, h'- 
took on the responsibility for some grounds 
-laintainance (picking up litter) which allowed him 
to work outside, which he liked. In addition, he 
washed wheelchairs, trashcans. windows and h? 
kept one area swept .i«k1 mopped each day. At other 
times, he assisted in stocking linen and supply 
closets toward the goal of taking on this duty at 
a later time. In the Cafeteria. R.W. cleaned 
tables, stocked cond Imonts . swept and generally 
kept the area clean during his shift. His 
schedule included; 

9:00 Sign in-Volunteer Office 
Pick up meal ticket 

Report to job coach-Vocational Services 

9:00-10:00Housekeeping Dept. 

10:00-10:15 Break with other Housekeeping 
workers 

10: 15-11 ;00 Cafeteria work 

11:00-12:00 Housekeeping Dept, 

12:00-12:30 Lunch (on his own in Cafeteria) 

12:30-1 :30 Cafeteria work 
1:30-2:30 Exercise in Health Fitness Program 
Occasionally his schedule would be changed to look 
at R.W.s ability to be flexible in work duties 
and he could be loaned to another department to 
work on a special project, with supervision. 
There is a possibility that a paid position may 
be able to be justified for R.W. in the House- 
keeping Department and if he Is able to learn 
to function in a norm^il work setting, he will 
be able to obtain a rr Jerence and recommendation 
for a competitive job in the community. He wil i be 
able to utilli^e a job coach for support who has 
alreac'y identified compensatory strategies that 
helped make the situational assessment successful, 
.^Ince there was no previous work experience, the 
situational assessment gives him an opportunity 
to find out through experience which job tasks 
are most satisfying to him. 

il^XL"J'M'?iL^ ..^^Y-iLl^iLyil'^^ '^'^^ Kefdbnck 

Kach p/irtlclpar t .in .situational ni,s(vsMmenr 
is provided with job coach fujpport services. The 
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Job coach provides daily und weekly vcrhal Tecd- 
back to the person beinR evaluated. A check Mst 
is utilized for on-HlLc supcrvittors to mtc the 
person's performance in the following >\ieas: 
attendance, punctuality, flexibility, ability to 
work independently, accept supervision and 
follow policy and procedure, groomins -and hygiene 
and gel tine ^*long with co-workers. Stamina 
and endurance are evaluated with work speed and 
accuracy. Problem areas are identified and 
gonls arc set to learn compensatory striMtCRy, 
modify behavior or improve performance. Written 
performance feedback is available to the person 
from on-aite supervisors and progress notes are 
maintained in case records by the job coach* 
Individual counseling is available as needed. 

Feedback is vital to be able to impact on 
the lack of insight or denial of limitotiona. 
If the person does not perceive the situational 
assessment as real or productive work, then the 
feedback will have no value. On the other side 
of the coin, if the person performs the work and 
does not receive adequate feedback in a form 
that can be understood and incorporated into 
realistic plans and goals, then the situational 
assessment may have no value other than keeping 
the person busy and getting some work done. The 
feedback will be more effective if understood. 

The goal of situational assessment ip o 
increase self-awareness of strengths ar.' nitp- 
tions. Often tlie individual after TBI vx^l je 
unable Ko evaluate their performance or monitrr 
progress. Job coaching with this population 
involves teaching the individual to monitov 
their own performance and identify problom nreas 
and compensatory strategies to aid in fielf- 
evaluation toward the goal of independence. 
Time management logs, behavior or activity 
check-lists, daily planners, computers with 
memory for scheduling and financial management, 
and other aidus such as a watch with alarms set 
to remind the person to takr. medication or a 
computer spell-check program can make a person 
more independent. 

D'igveloi)iii g Job Desc «xptions 

Job descriptions were written for each 
placement in situational aasessment so duties 
and qualifications needed for succesP were 
rlearly stated. The following job (^iscription 
rxamples were developed by C.Z. during hnr own 
situational assess^fnt. C.Z. received a TBI 
classiUed as mild at the time (three yeM'-s ago) 
and was released with no therapy. She had passed 
the bar exam three months before her injury and 
hr.d been working in a law firm as a courtroom 
attorney. Persi&tent cognitive problems, physical 
syn^ptoms a ;d medication si 'c effects have com- 
Ijlned to prevent her from eing successful in 
her attempt to return to work either to her 
previous job (they sent her a registered letter 
to fire her from th3 firm) or another part-time 
job in a different firm. Vocational Rrhnhilitn- 
tion referred her for supported employment 
services and she was involved in vocational 
rvnluation, work adjustment (psychological) and 
situational aj;serijmt»nt . lUio was given a forniat 
for the job descrlptioiia to follow. C.Z. then 
interviewed supervisor:! and workers in specified 



situational assessment placements and combined 
their information on her perfsonnl computer nt ho\m 
and brought it in Cor review by the VoUmtocr 
Director and Vocational Seivices Directov, before 
filial printing. The hospital attorncyr. hrive been 
asked to create a * para-legal' assigiraent for 
further situational assessment of this individual. 

Job Descriptions ; Example s 

The I'ormnt for cncli job doscr i ptinn 
included job title, person responsible to, 
purpose, duties, time required, in-service 
training requirement, qualifications and a date 
to show when the Job aescripMon was developed. 
These examples reflect only part of the full 
job descriptions. 
Job Title: Pharmacy Volunteer 

Purpose: To assist the Pharmacy Department to 
erthance efficiency and improve 
productivity clerically 

Duties: 1. Assist with passing out medication 

2. Make deliveries as necessary 

3. Check for out dated drugs 
A. Type labels 

Qualifications: 

1. Light typing skills 

2. Physically mobile 

3. Cooperative, reliable, dependable 
^. Accuracy I good attention to detail 

Job Title: Clerical Assistant /Urology Department 
Purpose: To provide clerical support for 

Urology Dept. 
Duties: I. lb type envelopes, forms and labels 

2. Alphabetically filing patient record 

3. Answer phone and take messages 
A. Make copies, deliver mail 

Q tialif dcations: 

1 . Accuracy and attention to detail 

2. Good communication skills and 
verbal ability for telephone answer 

3. cooperation and flexibility 

^. Ability to work qOietly in an area 
of work which is crowded with four 
nurses doing telephone and 
documentation at their desks. 

Supported E mployment 

Our experience supports the one-on-^one job 
coach model of supported employment services as 
the model most able to meet individual needs. The 
definition of supported employment involves at 
least 20 hours per week c impetitive employment in 
an integrated work setting winh lifelong support 
needs Survivors of TBI meet the lifelong support 
needs ^ ♦*erla because the psychological and 
emotiohu * physical and cognitive adjustment 
ii>8ues mr ♦ ?ver be fully resolved. Transitional 
services m. itsist some individuals in reaching 
an indepenofe. - status but the outcome is difficult 
to predict when n person is beginning their 
community re-entry pro^;ram. 

Vocational and neuro-psycho]ogical evaluation 
well as aituationnl assessment in an integrated 
setting can assist in determining strengths and 
limitations. Uealistic vocatiotial planning MWJt 
be based on individual needs and work readiness. 
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Somo aclvo(:;it;:s for supporLcd employrneui havo 
snr.r.OMtod that voc;ir lun.il evnlu.U ion mny not: ho 
nccc-ss.iry. HuwrVi r, In our t^xpt-r it-nco, ihc 
evftluution process i.^ crililcal. Situational 
assesamRnt has been a vital component of the 
evaluation and adjustmenr with survivors of 
traumatic head injuries and has filled a gap in 
our services delivery system between the medical 
setting', and successful community rcjintej^rati on . 

iUT.soM who luMU'IlLs Ll)c mosL from si t u.U i oim 1 
assessment is the individual, if the feedback 
can be presented in a manner that can be under- 
stood and incorporated into their self-concept 
toward the goal of gaining insight and realistic 
vocational planning. An evaluator or voration.il 
counselor may indeed know what kind oC job u- 
career is within the ability of the TM person, 
however, if the person does not hrvr- same 
'ocational goal or lacks awar..»n2;;5s of their own 
strengths and limitations, then the job match 
may be doomed to failure. The person may not 
be satisfied with tuG job and adjustment issues 
may interferf vith success no matter what kind 
of job coaching and support are available. 

Situational assessment can identify other 
services or cognitive re-training needs as we^l 
ae; compensatory strategies that will help prepare 
an individual for successful supported employment 
placement and training. The feedback gained 
is valuable to the individual and in cases where 
a person is returning to a previous job. the 
employer may be more easily convinced to give the 
person another chance or modify a job. Often, 
in wr experience, .siLuaLional assessment has 
led to supported employment opportunities. 
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INTEGRATING VOCATIONAL ASSESSMENTS WITH SPECIAL EDUCATION TRIENNIAL 

REEVALUATIONS: A MODEL 



EDWARD M. LEVINSON 



Abstract 

Thi« pap«r Argu«g in uupport of 
integrating th« vocational aiiantmant 
and irpacial aducation triannial 
raavaluation procaiiai for handicappad 
■tudanta at tha lacondary aohool laval . 
Advantagaa of intagrating tha two 
prooa«a«i i, diacuaaad, and a modal 
urogram intagrating tha two proowiiai ia 
briafly daaoribad. 



Federal regulations governing 
implementation of P,L. 94-142, The 
Education for All Handicapped Children 
Act, requxre that handicapped children 
participating in special education 
program* be reevaluated for these 
service! once every three years, or more 
frequently if conditions warrant. This 
evaluation is typically conducted as a 
multidisciplinary endeavor , involving 
many school personnel including; school 
psychologistr, school nurses, te^^chers, 
and guidance counselors . 
gathered re.lative to the 
intellactual , 

social/emotional , and 
functioning, and is used to aetermine 
student progress, the need for continued 
special sarvice , and unmet areas of 
need. Unfortunately, an assessment of 
|Vocational functioning is not required 
by law to be a component of this 
evaluation . 

Vocational assessment is defined by 
the Vocational Evaluation and Work 
jAasociation as "a comprehensive process 
that systematically uses work, real or 
simulated, as the focal point for 
assesBment and vocational 
the purpose of which is 
individuals in vocational 
evaluation 
psychological . 
and economic 



Data is 
student ' s 
academic , 
physical 
determine 



Vocational 
medical , 
vocational 
attainment 
evaluation 



exploration , 
to assist 
development . 
incorporates 
social , 
data in the 



of the goals of the 
A process." Clearly, this 

definition suggests that much of the 
•ame information gathered as part of a 
handicapped student's special education 
reevaluation is also information 
gathered as part of a comprehensive 
vocational assessment. That is, medical, 
psychological, educational, and social 
information should be Qathered when 
completing either a comprehensive 
vocational assessment, or a special 
education triennial reevaluation. Given 
the overlap between the information 
gathered as a function of completing 
each of these evaluations, thin author 
recommend, thai the two processes be 
integrated and combined for handicapped 
students participating in school based 
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special education programs. That is, for 
these students, the vocational 
assessment and special education 
triennial reevaluation processes should 
become one in the same evaluation. 

There are a number of advantages to 
combining these two processes. The 
degree to which the two proceRses 
complement each other renders each more 
effective in combination that each would • 
be if completed iilone. Given the overlap 
in the information gathered for each of 
these two evaluations, combining the 
processes reduces redundant information 
gathering. Rather than having the same 
school based professionals gathering the 
same information at two different times 
for two different purposes, an 
(interfacing of the two processes creates 
a time and cost efficient method of 
assessment and educational planning. 
Because both the special education 
reevaluation and vocational assessment 
processes must be multidisciplinary in 
nature, and because this 

multidisciplinary tea n oriented approach 
to assessment is already in place in 
schools via the federally mandated 
triennial reevaluation process, it again 
makes sense to combine the two 
processes, rather than completing 
vocational assessments separately. With 
personnel training and slight 

modification of data gathering 
iprocedures^ the various professionals 
involved in the triennial reevaluation 
process can learn to gather additional 
information relevant to the vocational 
planning process, and can learn to ^use 
this information in vocational planning. 
Lastly, some vocational assessments 
completed in the schools are not 
comprehensive in scopS; are completed in 
isolation, and do not consider 
psychological, educational, social, and 
medical data. That is, an assessment of 
vocational functioning is completed 
without consideration of a student's 
other aspects of functioning. Obviously, 
such a narrow assessment focus restricts 
one's ability to understand and use the 
information which has b en gathered. 
Combining the vocational assessment and 
special education reevaluation processes 



insures comprehensiveness, allows tor a 
holistic assessmont of the student, and 
encourages the devel opment o t a 
vocational plan based upon all aspects 
of a student ' s functioning . 

Consequently , the author offers the 
following vocational assessment model 
which int egrat es the vocational 
assessment and special education 
reevaluation processes . Consistent with 
many conte»t^Porary assesssment programs, 
the model incoporates a two phase 
assessment plan. A Phase 1 vocational 
assessment is conducted at the time of a 
handicapped student's triennial 

reevaluation in either the 6th , 7th , or 
8th grades , depending upon when the 
student is due for their triennial 
reevaluat i on . All handicapped students 
participating in special education' 
programs must be subjected to a 
reevaluation in one of these three grade 
levels, since the law requires that the 
evaluation be completed once every three 
years. A vocational evaluator is a 
member of the multidisciplinary team 
conducting the reevaluation, and I 
collects information relative to 
vocational interests, vocational 

aptitudes, and work habits. Other team 
members are involved in gathering 
vocationally specific information as 
well as their traditional information. 
For example, the school psychologists, 
iin addition to completing a traditional 
psychological evaluation of the student, 
may also assess vocational interests and 
work habits via interviewing, 

observations, and use of paper and 
pencil tests. The school social worker, 
in addition to completing a social 
history, may gather information relative 
to the vocational expectations parents 
possess for their children, and the 
degree to which those expectations are 
realistic. They may also consult with 
parents as to what pr i or work 
experiences and vocational interests the 
student has. Teachers, guidance 
counselors, and others may also gather 
similar information via interviews with 
and observations of the student . 
Following information gathering , a 
multidisciplinary staffing is conducted 
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in which all information is shared. and 
recommendations an? made relative to 
edij.ational and vocational placements, 
and instructional needs. The vocational 
evaluator can combine .11 vocationally 
specific information gathered by the 
team, and assist the team in the 
development of a vocati nal component 
tor the student's Indiv al 
Plan (lEP) . 

A Phase 2 assessment is 
during the 9th, 10th, or 11th grade, 
again depending upon when the student is 
due for the: r triennial reevaluat ion . 
The Phase 2 assessment is upon referral 
^"^y^ and is for those students for whom 
the Phase 1 asai^asmont was inadequate 
for planning, or who require a more 
comprr>hensive, experientially based 
asse«sment for program planning. The 
Phase 2 assessment is completed at a 
regional vocational asseaement center by 
vocational evaluators , utilising work 
sampling, situational assessment, and 
simulated work experience asRecsment 
technology. The results of this 4 1/2 
day assessment are also combined with 
the aatk gathered by other team members, 
presented at the trit-nni?,! reovaluation 
staffing, and us^^d in the devolopment of 
a vocational component of the tha 
student's lEP. 

This paper h&P argued that the 
integration of the vocational a^Ressment 
and special aducation triennial 
reevalualion processes for handicapped 
students will xosu.U in evaluation 
process which will be comprehensive, and 
time and cost efficient, 

mulidisciplinary in scope, and wil^ 
consider all aspects of a student' 3 
functioning. It iy recommond^ad th.tt 
those in the process of devolopinc; 
school bas.>d vocational r.sseEBment 
programs consider such interfacing of 
the two processes. Those r^adfirs 
interasted in a more d€»tailed dife. ^sion 
of the means by which such an integrated 
assessment progrcxm might be developed 
are referred to Lsvinson & Cappc (1985) 
Hohonshi 1 , Le-inson , & Bucklanc>Hner 
(.1985), and Levinson, Peterson. &, Elston 
(in press) . 
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THE ROLE OF SCHOOL PSYCHOLOGY TN VOCATIONAL ASSESSMENT 



EDWARD LfiVINBON 



Abetract 

This paper diecuaBes the roles that 
school psychologista can aseuroa in the 
vocational assessment of handicapped 
youth. It is argued that echool 
psychologists, by virtue of their 
exp^^rtise in intellectual, academic, and 
personality aaseeRment, can aeaiiit 
vocational evaluators and other tschool 
based professionals in gathering data 
relevant to the vonational planning 
process . 



In recent years, much has been written 
relative to the fschool peychologist ' s 
involvement in the vocational 

programming of handicapped «tudent8, 
particularly in regard ^o the provji.sion 
of vocational assessment serviceij 
(Capps, Levineon & Hohenshil, 1986; 
Heinlein , Nelson , 8i Kohensnil , 1985 ; 
Hohenshil, 1982; Hohenshil, Anderson, ft 
Salwan , 1982 ; Hohenshil , Levinacn , & 
Buckland-Heer, 1985; Levinson, 1984; 
. Lovinaon & Capps , 1985 ; Levinson & 
Shepard, 1982; rihepard & Levinson, 
1985). That two major publications of 
the National Association of School 
Psychologists ( Beat Pra r^tiQQg Sphool 

E£L5tflilClii£y- and GJlLLdU'janlfl Needs t 

EfiXi±alQiLlaal_-Ei^apfii^ each includ© 
a chapter relevant to the topic of 
vocational programming (Koh(in)shil , 
Levinson , & Buckiand- Keer , 1985 ; 
Levinson. 1987; respectively) attests to 
the significance of the topic for the 
profession of school psychology , 
Additionally, NASP's Eiva£fliiiiLii3trULl 

GonducLli ti£uual. (NASP, 1985) in its 

description of Standards for the 
Provision of School Psychological 
Services specifically ates that 
"Psycholc UGal and ps: loeducational 
assessments include cona ideration as 
appropriate in the areas of 
personal- social adjustment , 

intelligence-scholastic aptitude , 

adaptive behavior, language and 
communication skills, academic 

achievement , sensory and 

porceptual-motor function ing , 

environr ntal-cuJ tural influence's , and 

^catlonai -dftVjEaajBiafljal^ja^ aud 

inieroaia" (underlines added) (p.ol). in 
rrference to interventions. the 
Btandards state "school veyoholc |:^lGt6 
facilitate the delivery of services by 
assisting those who play major roles in 
the educational system (i.e. p«.rent«, 
school personnel, community agencies) . 
Such intorventions consist of but are 
not limited to : inservice training, 
organisational development , parent 
counseling, program planning and 
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evaluation, m^AidLi£mi&.J-jdfi^iiiQ^ and 
parent -sdacatlon r>x-ogramB" (underline 
added) (p.31). 

Reaoaroh hajs indicated that school 
pdycholofiieto »ro both intereated and to 
Bome extant involved in vooational 
aepectB oi ptactioe. Pfeffer (1978) in 
a 3urv^y of individuals in leadership 
poftitiona in HASP found that a majority 
of th<^ raepondentB viewed vooational 
oounflelin*? and vooational development ae 
^reatf in which school psychologietfi 
should particiif^ate. In a survey of 
Bohool aupjarintendenta, school 

paychologitttB . And aohool psychology 
trainern in Virginia, Murray (1975) 
found th^it adminiatering, occring, and 
intcivpretina vocational interest 
inventor ieo and making reoommendatione 
tor placement of etudenta in vocational 
training programs were aot'vitiea in 
which the r^»««pondentB reported that 
j school pBychol:^tfifit8 should be involved. 
Similarly, Shepard 4 Hohenshil (1983) 
reported thAt mor.^ than f>OX of their 
respondents indica vt^d sow© involvement 
in identifying handicapped students for 
vocational programs and in making 
iGCominendations to administrators 
regarding vooational placements. Most 
recently, Levinaon (1986) studied 
Pennaylvania school psychologists and 
f^und that to some degree 34X had» 
performed vooational assecament, 39% had 
porforwod vocationaT counseling, 41% had 
consulted wiOh vocational instructors, 
And that 13% had performed vocational 
program or curriculum development, 
activities in their practice. 

There are pragmatic and practical 
Y^naon^ for the school psyohologist 's 
involV€?m«nt in vocational endeavors. 
• Many definitions of vocational 
aB'>AB«m3nt, such Bt that proposed by the 
Voczitional Evaiudtion and Work 
^djuatment Association (VKWAA) .VEKWA, 
1975), actuall/ incoporata a 
psychological component. It is a well; 
accepted notion that intelligence test, 
data, academic achievement test drta, 
personality assoBsment data and adaptive: 
behavior data all have relevance £or 
vocational prograrnming. 



Although school psychologists 
perform a variety of roles in the 
schools, a major responsibility is the 
coirpletion of pBychoeducational 
evaluations of handicapped children. It 
is via this assessment role that school 
psychologists can assist in the 
icottpletion of school based vocational 
assessments. Much of the data gleaned 
from a traditional peychoeducational 
evaluation has vocational relevance. For 
example, intelligence test data can be 
used to assist in determining the degree 
to which an individual might attain 
success in a given vocational training 
program, and the degrej to which certain 
Jobs which emanate from training in a 
given program may be rec-'listic 
vocational options for the ; . ien^ . 
Research conducted by Heinlein (1987), 
for example , has indicated that the 
factor structure of the Wecheler 
Intelligence Scale is similar to the 
factor structure of some aptitude tests. 
This data eupports such use of 
intelligence teat data , and also 
suggests that, in some waye, 
intelligence test data gleaned by school 
pasyohologists may be used in the same 
way as traditional aptitude test data. 
Future research of thie nature may 
eventually support the substitution of 
aptitude test data with intelligbnce 
test data, thereby eliminating the need 
for expensive and time consuming 
aptitude assessment. Since most clients 
participating in vocational assessments 
will already have been tested with 
intelligence tests (and this information 
will already be available) , such 
substitution may serve to streamline the 
vocational asaesement process , and 
render the process more efficient. 
Because many frequently used 
intelligence tests are superior to 
aptitude tests in regard to psychometric 
and technical. characterietics , such 
substitution may also serve to increase 
the reliability and validity of the 
overall assessment process. At the 
present time it is premature to 
substitute aptitude data with 
intelligence test data, and both should 
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continue to be considered in vocational 
aseessmente . 

MS part of their psychoeducational 
asBeesments, school psychologiats 
frequently asseBS academic functioning 
and adaptive behavior. Like intelligence 
teatlng, achievewent testing and 
asBessment of adaptive behavior cb,n be 
used to identify deficits in academic 
and social skills that might obstruct 
vocational training and placement. 
School psychologists are perhaps the 
most competent school based professional 
to conduct personality assessments » and 
frequently include such an aasoasmant in 
each of their psychoeducational 
evaluations. Prirsonality assessment data 
can be used to identify the degree to 
which traits pobb^ssed by an individual 
will either assist or inhibit training 
and eventual functioning in a particular 
occupation. Holland (1985) has argued 
that the choice of a vocation is simply 
the e) >ression of personality, and has 
demonstrated that individuals who choose 
similar occupations have similar 
personalities. Research has indicated 
that personality assessment data can be 
used to predict both Job performance and 
Job satisfaction (Holland, 1985). Given! 
the intimate relationship which exists 
between personality and vocational* 
adjustment, the school psychologist's 
ability to assess personality may be the 
psychologist's most valued contribution 
to the vocational assessment process. 

In addition to psychoeducational 
skills, consultation and intervention 
skills can be applied by the school 
to facilitate the 
evaluation process , 

can be requested to 
vocational e valuators 
appropriate assessment 



psychologibt 
vocational 
Psychologists 
consult with 
concerning 



instruments and strategies to employ 
with a particular client, and the degree 
to which intellectual and 

social/emotional difficulties may affect 
a client's training or employability . 
Psychologists can also effectively 
interpret the results of evaluations to 
medical, special education and 
vocational training personnel, and work 
with these profesBiorals in developing 



an overall rehabilitation plan for a 
client. 

Finally, the development and 
implementation of school-based 

vocational asseflsment programs involves 
the selection, use and interpretation of 
vocational tests, As Egerman & Gilbert 
(1969) have previously suggested, those 
professionals frequently entrusted with 
this responsibility have had limited 
training in psychology, and are often 
times ill-prepared to deal with the 
psychometric and measurement issues that 
development and implementation of an 
assessment program requires , In 
contrast, school psychologists are well 
trained in assessment methodology, and 
knowledgeable about psychometric and 
measurement issues , Consequontly , 
involvement of the school psychologist 
in the establishment and implementation 
of a vocational assessment program can 
reduce the risk of inappropriate 
selection, use, and interpretation of 
assessment instruments, and increase the 
overall validity of the vocational 
assessment process . 

Although the initiation and . 
implementation of school based 
vocational assessment programs must be 
multidisoiplinary in nature, this paper 
has argued that school psychologists, by 
virtue of their expertise in 
intellectual, academic, and personality 
assessment, may come to assume a key. 
Vole in the vocational assessment 
process, It is hoped that this paper has 
outlined the degree to which school 
psychologists can support the vocational 
assessment process, and has encouraged 
vocational evaluators to seek out the 
services of school psychologists and 
work collaboratively with them when 
conducting vocational assessments of 
handicapped students. 
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CURRICULUM BASED VOCATIONAI. ASSESSMEWl' 
AT 'I'llK MIDDr.I3 AND SirONDARY SCIKXX, 

JUDY SWISm^R _ VOCATTONAl, EVALUATOR 
SI-iAlVNEE MISSION SCHOOLS 
SHAWNEE MISSION, KANSAS 



Abstract 

Hie process of curriculum based vocational 
assessment in Shawnee Mission Schools began at the 
middle school level with the developient of the 
Practical Arts Evaluation System. Practical arts 
courses in business, hone economics, and industrial 
arts are the basic foundation of successful parti- 
cipation in regular vocational education programs, 
therefore, the initial process for curriculun based 
vocational evaluation in this district included 
the development of an evaluation systan vMch 
would provide meaningful and relevant business, 
none econcndcs, and industrial arts information 
^^Pon vAiich reocmendations could be made for 
further vocational programing. 

Practical Arts Evaluation 

Itie ultinate purpose of the Practical Arts 
Evaluation System is to give special needs students 
m grades 7 - 12 an opportunity to eiff)lore a wide 
range of "hands-on" skills which they would en- 
counter m regular pracUcal arts classes, vocation- 
al classes, and aiployment. Within the framework 
of a simulated vork environment students ocnplete 
a progression of over 140 work sanple activities 
designed to evaluate basic skills in the ar^as of 
business, hone econaniics, and industrial arts 

With the increasing aiphasis for special 'needs 
students to have exposure to the worfcLng world and 
regular vocational programs this evaluation system 
allows students to experience an overall introduc- 
tion to pracUcal arts skills and at the sains time 
provides evaluation dato which addresses the 
following questions: 

1. What practical arts skills are students 
actually able to perform? 

2. How much assistance do they require to 
oorplete those skills? 

3. vaiat is the quality of their work? 

4. Is their work rate at a ccnpetitive level? 
5- What kiivls of skills interest thern the 

most? 

The results of the evaluation are used to 

^tIo^''^'''°"f additional pre-VTx:aaonal, 
vocational, and work experience training. For 

JSt°ofIif ^""^"^ evaluation ia^formtion is 
iTOst ofteji used to make reoonmendaticns for work 
experience and regidar vocational prograire. For 
rmddle school and junior high students the infoxira- 
^S^n.'? P^^ily as a basis for placentmt in 
opecaal needs practical arts programs, other special 
vocational needs programs, and regular practical 
arts cldsses. 

At the end of the evaluation tenn a smrnxy 
report of rasul±s is prei>arGd and .sent to desic-natrd 
individuals . 'il^e infoniution on the sunimty ^po^ 
is also iLsed by sr^cial education staff to dcx-iitt-nt 
vocational strengths and weaknesses on the lEP as 



well as to determine short and long term goals, 
^-ho 4.^ ^ categories of activiUes within 
the three ai.ias of business, hone econcnuos, and 

i^nnS'f .^"^ '^^^^ has 6 activities 

1^ uff.^^ actLvities within the category of 
alphabetizing students place 26 cards in alphabeti- 

S °' ^ activitieTSe'^re 

BUSInSs^'*'^^ ^ ^^^"^^ °^ ^ categories: 
Alphabetizing 
Library Card Filing 
Numerical Sorting and Sequencing 
Collating 
Typing 

Making change 

Cash Register 

Ten Key Adding Machine 
HOME EOO^gDMICS 

Food Msasurenent 

Food Service 

Food Preparation 

Food Vteights 

Cloth Measurement 

Ikmd Sewing 

Madiine Sewing 

Cloth Construction 

Telling Time 
INDUSTRIAL ARTS 

Shop Measurement 

Using wGnc.he.3 and bolts 

Using screws and nails 

Using shop saws 

Wood Projects 

Electrical Projects 

Metal Projects 

Administration 

Ihe basic fonrat of this evaluation system 
rZ u prograimtxl instrucUon process 

whereby the student corpetes with himse] r/Self 
instead of with a noiTied group of individuals By 
Siai'S^iT ^^f^^-^, activities which dj.recUy 
relate to the vaiaous cuiTiculu>ii areas, evaluation 
liiformation bea^s boU. diagnostic and presSi^Sve 

The pri'rary purpo'se of the system i.s to ewiluate 

as opix^ed to instruct in ^e basic skills and^^^ 

behaaors associated with success in entry level 

ei^loyimnt and regular practical art.s/vo2tioml 

prograr.is. The learning which takes place is Durelv 

incidental to the evaluation proc:ess and is a relat 

?ri-?u?f!; f^^"*^^->J- instruction provided from one 
activity to the next. 

For additional infortnation OTntact: 

Judy Swisher - nrcjadiTioor Center JCAVIS 
913 642-3130 
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KOI.L OK ASSKSSMKNT IN THK TRANS IT lON/ KOUCAT ION i>K()(;KSS 



Tl-RRY SCHMHV., PRISSIDENT 
THK CONOVER COMl^ANY 



Abstrac t 

More and moro emphasis Ls being placed on the 
consolidation of etforts on all programs thaf 
serve special needs, at-risk, and limited 
English proficient (LEP) youth and adults. This 
consolidation is directed toward assisting the 
individual in becoming a fully-participating 
member of our society. This approach, encour- 
aged by the force of federal laws, focuses on 
thp total needs of the student or client rather 
than 1 sin^jle aspect or need. The overriding 
goal .s the smooth transition from school or 
institution to tho workplace. The focus of this 
calk is on the roll of assessment in the tran- 
sition process. Tssnes covered within this 
talk are: interest , career planning, 

values/self-concept, voctL_ .. ^ 
vocational assessment, workplace nr--,uv 
communications, social skills, and reasoning 
skills) cind employabili ty skills. 



MODUL1 1 Career intercAU 



L 



MODULI 9 Cjirvcr Plannlilu 



MODUL»: 3\Uui-ji & Solf-Conccpi 



MODULI 4 \bcalloruU ExpIoralJon & Assessmcm 



MODULE SH;isk Skills 



MODULI e Workplace Math 



MODULI 7 NXbrkpUcr Enj(lljt)) 



MODULI • AKbrkpUce SiKiad .SkUls 



MODULt 9 \**)rkplnt f Hi-asoiHnR Skills 



MODUL1 10 F.nip)0)*JhilltvSkllU 
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We will beftin this talh by examining what 
has recently taken place in the field of voca- 
tional assessment in the educational process 
On October 19, 1984, l>ublic Law 98-524 of Lhe 
98th Congress of the United States passed the 
Carl D. Perkins Vocational EducatioT Act 
(HR4164). This law for-ed all secondary high 
school vocational education programs that re- 
ceive federal funds to comply with the new 
federal law. Part of the federal law (Title 2A) 
required that each handicapped or disadvantaged 
student that enrolls in a vocational education 
program shall receive "an assessment of Inter- 
est, abilUli-H, and .special ntiods of kucIi 
student with respect to completing successfully 
tho vocational udiicatton proKrain". That was 
one of five prescriptive requirements under 
Title 2A. 

That above-mentioned requirement is where 
the problems began for vocational assessment in 
Mie schools. Up until 1984 it was a voluntary 
act lo- Kfhool distri, ts to set up an assessment 
program, ana ^fter 1984 it became federal law 
The window of opr>ortunlty has been opened for 
vocational nssessinent in the schools. Unfortu- 
nately, little or no knowledge existed within 
the educational community as to the proper 
approaches in setting up a useful vocational 
assessment process. Many millions of dollars 
have been spent since 1984 in an attempt to 
meet the requirements of this law. Unfortu- 
nately, very few assessment programs have been 
cirefully thought out, planned, and Implemented 
Ilie result is a very negative mark on vocational 
assessment for the whole industry. 

The intent cf this talk is to try to help 
clear the air, and to forge a direction that can 
be useful for both education and vocational 
asscissment per.sonnel. It i.s my belief that vo- 
cation;! 1 a.s.sfs.sment cnn he ;i very vlt.il nnd 
effective tool in not only placing students in 
programs, but, more importantly, in helping 
guide school personnel on curriculum matters. 

Let's take a look at why vocational assess- 
ment has failed in the educational system; then 
we will take a look at what recommendations I 
propose to improve the delivery of vocational 
assessment services in an educational setting. 
I believe that the major reason for the failure 
was that there was little or no understanding as 
to the fLindamontci; needs of the educational 
prori-ss by p,.„|,)e ^i,,, ^..^^^ si-ttlng up vocal ionnl 
.■i.ssc..s.smenl: systems under the Vocational j./luci,- 
tion Act of 1984. Keep in mind that the ultimate 
coal l,s the .same for both .students and adults In 
Ihc asse.ssmonl proc-ess-lh;.l role hoJ,,,; cMiipl oymrnt , 
Howev.T, one m^or difference is thai: the students 
who are to receive the vocational a.sser„sment are 
••.pproximntely 13 to 14 year. „id, .nnd or. in the 
»'h or 9th grade. Thcv will not be ready to enter 
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the labor force for some years. Therefore, the 
assessment process must be Reared ijround wliiir: 
can be done with the student in the educational 
process . 

Simply stated, I believe that there are 
two different models of assessment. There Is 
an educational model, which functions In the 
educational setting, and a medical model, 
which functions In more of a rehabilitation 
setting. The educational model must be sensi- 
tive to the type and age level of the student. 
The younger the age, the more career-explora- 
tion activity should be Incorporated into the 
vocational assessment process, coupled with 
academic assessment and remediation related to 
the workplace. 

Vocational assessment in the educational 
setting is a process. It is not an event. It 
is a developmental process that begins with in- 
terest identification, and ends with an indi- 
vidualized corapetency-baacd vocational plan. 
This plan, since it is formed in a develop- 
mental process, must be assessed on an ongoing 
basis, and adjustments made as needed, I 
personally feel that aptituce assessment 
approaches in a secondary educational program 
have little or nothing to do with what is truly 
needed in the asaessuent process for the stu- 
dent, I believe that the model should begin 
with Intereflt 8cre/?ninB, and the results should 
relate directly to courses that an individual 
should take while in middle or high school. 
This tnterest-screering device should be util- 
ized between the 6rh and 8tb grftdes. 

After intereflt screening, career planning 
is the next fltep» Career planning should in- 
clude the opportunity to explore careers by 
reading occupational briefs, by viewing film- 
strips, by taking a look at various vocational 
propranm within rhe flnhool difltrict, by lookin^i 
.It ofcupotloiial. sertingfl within the community, 
and any other information the student can ob- 
tain about the occupation. 

The next step is occupational exploration 
through the use of work samples. I believe 
that work samples can be a very viable tool for 
the student to provide an opportunity to 
explore careers. Keep in mind that we are 
keeping this at more of an exploratory activity 
than an aptitude assessment approach. In 
exploration of work samples, a crossover into 
academics, la very important, This is espec- 
ially true when dealing with the at-risk or 
drop-out-prone students who see little or no 
relationship between interests and academic 
skills, Once this crossover has been estab- 
lished, and Intereflt patterns have become 
more defined, aasessment of basic skills re- 
lated to the workplace should take precedence. 
Thifl might occur in the 8th or 9th grade. 

I strongly recommend reviewing the work 
of Arthui' Smith (1975) or James Grcenan (1983). 
The scope of their work centered around analyzing 
worki-rH In vnrJouH Job nUuntLon. ,jnd findlnn 
out what types of academic competencies are 
necessary in order to function within their Jobs. 
The results show that there are four common 
nreos: math, communications (speakinR, llHten- 
Luj;, reading, end writing), social, and reasoning 



skills. These tour areas are what 1 refer to as 
workplace liti^racy. 

We at The Conover Company have been develop- 
ing assessment and remediation systems built 
around this approach to workplace literacy si.nce 
1981. I truly bellsve that the keys to opportun- 
ity within the workplace have everything to do 
with the person's ability to function in those 
four critical areas. Unfortunately, most of the 
assessment approaches developed in the past have 
centered around eleven aptitudes of The Diction- 
a ry of Occupational Titles, and the general edu- 
catioril development requirements for the occupa- 
tion. Although this information is useful, ic: 
has little value when planning the curriculum for 
an 8th or 9th grade student. 

Recent Department of Labor funding for JTPA, 
along with the major revisions in Che Adult Edu- 
cation Act of the Elementary and Secondary School 
Improvement Amendments of 1988 (VLlOO-297), and 
also the Omnibus Trade and Competitiveness Act 
of 1988 all target the same issue— workplace 
literacy. Workplace literacy, or the ability to 
handle simple math, communications, social and 
reasoning skills, are the essentials for success 
in the workplace, and should be the foundation 
for the assessment process in the educational 
setting. If a atudent i» to truly make a smooth 
transition from school to work, then th:: assess- 
ment process should be in place to help. But 1p 
order for the assessment process to be useful, 
the educational setting has to be geared toward 
the needs of both the student and the employer, 
Voca^-ionnl assessment 1fl therefore? challenged to 
m/»ke Itself more meanjng<:ul for this educational 
process. 

Meaningful data collected on students about 
interests and relative academic abilities as 
they relate to the workplace, can serve ss useful 
tools in rhf* chal.li?nge to mnko education more 
responsive to preparing people tor the workplace. 



Smith, Arthur, Generic Ski lls: Research and 
Development , Prince Albert, Saskatchewan, Canada*. 
Training and Development Station, 1975. 

Greenan, J, P., Identification of Gen eralizable 
Skills in Secondary Vocational ProRrams : Exec- 
utive Summary . Springfield: Illinois State 
Board of Education/Department of Adult, Vocational 
and Technical Education, 1983^ 
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An InlerveiUioM Scrdte^y for High School Dropouts 



Margaret G, WiUerson, M,R.C,, U,P,C,» CV.U, 



A b s c r /J c t 

A projirHU) consist Inj; of a vocatiniwU 
»•* V/ a 1 u « t i o n / rl t» v I o i^n o n t c o in p o n o n t n n d a 
rondlnj;, component was provided for 25 
youths who ha<i dropped out of hj:;h 
school. The pro.v;rai:i v/as providod usln)^ 
Uu> facilitl^.s of Arknns/as Tech 
University (ATU) located in 
RuBsellvllle^ Arkansijs » and was funded 
by cj locnl coinrnnnlty service ri^jcncy 
that hnd specificfllly r»Miupstod thn 
vocattonal .nnd rt.ndlr^r conpontMits as n 
service for arva youths wlio hnd droppod 
out of hirJi school. Pro;:rnm purposws 
wt-rt- to otuHy, av.HQr,^ tind pval'intfi tho 
vociittonnl pottMitlnl of indlvldunl 
p n r t i c 1 p u n t s ; to p r o v t d t» n r e d 1 n ^ 
p r u K r a in nnd n t? s o .s s the « i n s of 
individuals .i c c o « s I n ); t h o r u- n d i n 
proxjrain; to oncour/jj;H indivtduiil' 
i n vo ! voin^n t of p n r t ( c f p n n I: « in thr 
ovaUwulon process; to prt'pnrc* and 
•submit an individunl vo en t tonal 
I'.-vol r)p»,UMil: pliin Li) the funding 'Dt^-ncy; 
and to provide follow-up aervices 
;iinin)^ tov/ard mnintainin^ successes, 
prevcHitinK failures, and pruvldin>'. a 
rL^fiOiirco for Individual Participants 1 :i 
llujlr ende/.ivors toward rurihcr 
education or irainin}^. Solf»cted 
jneasu rer.UMi t tools wv.to used Lo (^val-j/it*' 
program outcomes. Indicators of 
s u c c e a 5 wore established as Increased 
scores on sel-'cted measures from 
prc't 'St Lo poritt(?st. Other indicators 
of succeiis were based upon the number 
pa r t I cl ,)a n L s c o >.i p I o t t n;'. tht- suiii.i.-r 
p h a i\ e a n d f o I .1 o w - u p p li a s e o T f ii r? 
prot.ram. ftesults Indicated tliat tite 
nruup of participants who completed the 
suii.ner pro;; ram hnrl s I n i f i c a n t 
I ::ip rovement in reading* jol seeking', 
and social skills. Results wer.- 
discussed in terms of program success, 
ways to improve pro^^ran i i'.ip 1 e me n t a t i o n , 
and :)e..d to continue ijuch a proitram. 



of 



out 
year. 



of 



did 



Mid April, 1988, representatives 
Arkansas River Valley Action 
Council/Job Training Partnership Act 
(ARVAC/JTPA), an area community service 
ai^ency serving; ten counties in 
Arkansas, rae t with representatives of 
Arkansas Tech University Behavioral 
Sciences faculty to request the faculty 
develop and irapleraent a youth (age 
1^-21) reading, vocational evaluation, 
and follow-up ,)rograin for a maximum of 
50 youths that had been dropped 
^igh school for at least one 
ARVAC/JTPA wanted the program 
implemented by summer of 1988 which 
not alio-/ extensive -Planning and 
pre-pro^ram study. 

In establishing a need for such a 
program, there was an implicit 
assumption (duo in part to ARVAC/JTPA's 
willingness to request and pay for a 
program which might be helpful to high 
school dropouts) tiiSt there i/as a 
problem in Arkansas with hig i school 
dropouts* Media reports and political 
attention directed at the problem of 
high school dropouts and potential 
dropouts (at risk) helped solidify that 
assumption. 

Initial inquiries involved 
discussions wi^ii ARVAC/JTPA personnel, 
local school counselors, area school 
administrators, state education 
officials, and a review of limited 
materials about the Arkansas dropout 
po:»lation and other related reports 
about the problem of high school 
dropouts nationwide . 

A report. The Forgotten Half: 
Non-College Youth in America, by the 
William T. Grant Foundation (1988) 
showad there were approximately 20 
million 16-24 year olds in the United 
States who would not seek college 
education and many of these youths 
high school dropouts. The report 
indicated the lack of adv^^nced 
education would hinder youth in their 
attempts to support themselves and 
future families due in large part to 
unemployment, underemployment and/or 
lack of economic opportunity, Some 
the major conclusions of the 
included : 



were 



of 



report 



J 9.3 



I) the recognition that young 

people learn in different ways 
and that schools should offer 
• more flexibility in wh/s of 
teaching and places where 
t u gh t , 



208 



MTIONAL FORUM 



2 ) a r li c o m jn o. n <! a I: Ion l. lui L y o u n >^ 
people be e x p o s e (i t: o v a r i (Ui a 
occupations to I o n r n n b o u L work and 
about themselves. 

3) a recoinmendction chat schools 
encourage "dropplnj^ in" after a youth 
has recoftnijsed the value of school. 

A) a recommendation that 
)ovurnment and community institutions 
offer a variety of "added chance" 
propjraras for youth who are out of 
school and out of work. 

5) a ad a recommendation of 
greater investment in basic learning 
for disadvantaged cr^'idren* 

Information war, sought from both 
local school officials and written 
reports about the dropout problem in 
Arkansas. In 1985, Arkansas Advocates 
for Children and Families reported that 
20-30% of Arkansas youth either dropped 
out or were pushed out of high school. 
In October, 1987, the Arkansas Democrat 
published results of studies which 
indicated that 25% of Arkansas high 
school students dropped out. Both 
reports suggested the high dropout rate 
affected the state economy. 

One school official representing a 
school in Yell County, Arkansas, 
indicated the dropout rate for 1987 was 
approximately 30%. An informal 
telephone survey of eight area higl. 
schools, supplemented by reports from 
the State Department of Education, 
Indicated a dropout rate ranging from 
3-13% with 5-6% dropout rate being most 
often cited. Inquiry into the 
discrepancy between the 30% rate and 
the 5-6% rate cited by the schools 
resulted in information which 
established that most schools surveyed 
did not have consistent i n t e r -d i s t r i c t 
means to define, track, and establish 
the school^s dropout rate. The 
discrepancy between the 3 0% .'and 5-6% 
citations was not due to the one high 
school being Inadequate but to 
differences in computational methods* 
The 30% dropout rate was computed using 
a method which accounted for the number 
of students enrolling in the 9th grade 
or freshmen class and following that 
class through completion of the 12th 
grade. The lower estimates were b^sed 
upon the number of students enrolling 
in the 12th grade and the number 
completing the 12th grade or by simply 
establishing ^ rat on a yearly basis. 

A 1986-87 cState Department: of 
Education report of students removed 
from puptl n t t e n d ii n rolls; indiCMliMl 
the total enrollment in Arkansas public 
schools was 206,383 in grades 7 through 
12. The report jihowed that 9,706 
s t u d tMi t s dropped out ( 2,603 blacks, 
7,03 0 white, 73 other) during the 
1 9 8 6 - ft 7 s c li o o 1 y e n r which resulted In a 
^1.7% dropout rate. That rate was bafiod 
upon using a formula w h .1 c li was 



(! i f f e r e n r. Khuw 1. o c i\ \. districts u a e d to 
report their cl r o p o ii f rate. 

C 0 n s t s t f) n c a n d .i c u r ■) K r 
computation of the dropout rate wa.s/is 
an important consideration, (e.g. 
Strother, 1986; Hammock, 1986; Wohlage 
and Uutter, 1986). For example, a 5% 
dropout rate would hardly be considered 
as serious a problem as a 30% dropout 
rate. Tlie problem of inconsistent 
computation of the dropout rate did not 
seem peculiar to Arkansas. Deborah 
Strother (1986) reported, similar to my 
experience, that school districts used 
different methods to compute the 
dropout rate. 

Floyd Morgan Hammack (1986) 
suggested a twenty year old problem 
with consistency and comparability of 
dropout reports and found different 
computational formulas used by 
different districts. The most common 
computation reported by Hammack was the 
cross-. ectlonal rate obtained by 
dividing the number of dropouts by the 
total enrollment on a yearly basis. 
Other methods reported by Hammack were 
following a class through the secondary 
years and the projection method from 
c r o s s -s e c t 1 o na 1 data to four year 
rates. These three different 
approaches were discovered in the 
attempts to feather information on the 
dropouL late in Arkansas. Based upon 
inrormation I gathered from the 
Arkansas State Department of Education 
and local school districts, I concurred 
with Haramrck's criticism that much 
infomation obtained about the dropout 
rate was inadequate and confusing. 

One local high school counselor 
provided the following general 
description of the high school 'dropout 
or potential high school drop'-ut. The 
dropout was enrolled in lower level 
math courser., their p a r e n t .^j were not 
involved In the educational process, 
tlie student was In trouble ith the 
police, was an undisciplined student, 
was sick and had to go to the doctor 
frequently, didn't keep self neat and 
clean, had a low family income* and 
0,/erall probably was not functioning 
above the 6th grade level. 

This character! 7. at ion compared to 
a number of characteristics mentioned 
by St r (it her (1986) in her review of the 
dropOL\t problem. Similar 
characteristics mentioned were coming 
from lower Income families, mothers liad 
low educational e x p f? c t a t t o n s for t h o ( r 
c h I 1 d r V n , par v n ( s w o r r not i n I r r e .s I e il 
in monitoring child's school or 
nonschool acttvities, the student had 
more disciplinary problems in c h (j o 1 , 
and student grades n <i test s c o r e ^] were 
lower. Q t h e r 'i (e.g. I*. k 5: t r o in , Goari z, 
Pollack, if Rock , 1 986 ) discuss od 
(\ r o p o n t characteristics c o m p i\ r e d t: o 
5; t u d e n t ;i who stayed in s c h o o 1 . 
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Hropouts were c lui r a c t o r i y. ccj ns having 
lower self-esteem, lower moan math 
«cor«s, higher ratu of absenteeism, 
close friends who were also alienated 
from school, expressed an external 
locus of control, and other 
characteristics. 

Based apon information .eviewed 
and studied at tie time of establishinK 
need for the program, it became evident: 
the dropout problem was considered a 
national, state, and local problem. It 
was projected that the majority of the 
dropout population who would be 
enrolled in the program would have 
reading? skills below the 6th-7th Rrade 
level and also would be economically 
and socially disadvantaged. The 
♦estimated 20-303: of high school 
dropouts in Arkansas suKgested that 
traditional educational and community 
institutions had not adequately met the 
Individual needs of a significant 
number of Arkansas youths and that this 
drooout population wovld create 
economic burdens not only for the 
Individual but for the locale, the 
state, and the nation. 

Deborah Strother (.986, p. 326) 
defined tho, dropout as "an individual 
whose natural progression toward 
graduation from high school has been 
Interrupted." Section 5141 (b) (5) of 
Public Law 100-297 of 1988 102 Stat. 
262, defined school dropout as "an 
individual aged 5 through 18 who is not 
attending any school and who has not 
received a secondary school diploma or 
a certificate from a program of 
eculvalency for such a diploma." This 
dtflnitlon was temporary (no longer 
than 60 days from passage of the law) 
until the Secretary of Education had 
opportunity to consult with groups and 
organizations to establish a standard 
definition. Both definitions addressed 
the delay or i n t e r r u p ;: i o n of the 
educational Process. Discovering the 
reasons for the interruption or delay, 
preventing the interruption oi delay in 
the progression toward graduation, and 
offering alternative "added chance" 
programs were suggested means to 
address the problems of high school 
d ropou t s . 

The requested program was proposed 
as an "added chance" program to address 
problems of a population who had been 
dropped out of school for at least one 
year. T'.ie program was planned as an 
intervention strategy offering a means 
tor high school dropouts to learn more 
about their vocational assets and 
limitations, and develop reading skills 
from an instructional program o'^ 
re.iding, social skills and job seekinc 
s V 1 u s . 

The operational i.nncept w ri s that 
A.T.U. would provide the reading and 
vocational assessment program* Based 



upon the results of the vocational 
assessment, ARVAC/JTPA, the funding 
c-igency, would work with the individual 
to neet training and placement needs. 

The program was named Youth 
Vocational Development Program (YVDP) 
and individuals enrolled would be 
referred to as participants. 

Based upon information obtained, 
initial program design, and utilizing a 
participant centered philosophical 
approach, it was hypothesized that the 
intervention program would br 
successful in terms of participant 
achievement in reading skills, ]ob 
seeking skills, and social skills. 
Successful participant achievement was 
defined in terras of the stated 
quantitative program goals of 
increasing the total reading grade 
equivalent by six months, increasing 
the accurate completion of a job 
application form by 10-20%, and 
increasing the percentile rank on the 
Employabi li tv Maturity IntgrviA w by 
10-20 points. Improvement in social 
skills was measured by comparing an 
initial (pre) impression staff rating 
to an extended (post) impression staff 
rating. 

Population 

The population size was 
established as 25 participants rather 
than 50 because of facility, length of 
time required to complete a vocational 
evaluation, and the experimental nature 
of the program. Selection of the 25 
youths was based on age, dropout 
status, and financial eligibility. The 
participant had to be 14-21 years old 
have been dropped out for at least one 
year to avoid competition with public 
schools, and be financially eligible 
for ARVAC/JTPA services. The 
population was recruited and selected 
by the ARVAC/JTPA Youth Program 
Director. Twenty-eight participants 
were referred to YVDP, twenty-five 
participants actually started the 
program and three quarters through tlie 
program, eleven had dropped out* 
Fourteen participants completed the 
Program with pretest and posttest 
scores. Of those completing the 
program, there were seven males and 
seven females ranging in age from 16 to 
^1. The grade completed in high school 
ranged from 7 to 11. Due to limited 
time to recruit participants, four did 
not meet the selection criteria of 
having been out of school for at least 
one year. 

ilejLfLyjTje s 

Pretest and posttert scores on 
different measures determined if the 
program quantitative goals were met and 
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sofvud ns a n)en«.*=5 to teML tho 
hypothesis • 

The Nelson Denny RenllnK Test, 
form C, and thu Nelson Reading Skills 
Teat, Levels A,B,C - forms 3 and A were 
uaed fov pre and post reading measures. 
The Ohio literacy Test was used as a 
screening dtvice to determine which 
Nelson reading ceat to use with each 
participant • 

A standard application form and 
the Employabllity Maturity Interview , 
both developed by the Arkansas Research 
and Training Center In Vocational 
Rehabilitation, University of Arkansas, 
were used to test outcomes in job 
seeking skills. 

A criterion based behavior rating 
scale developed by adapting instruments 
from the Behavior Observation and 
Report Writing Manual by Singer and a 
discussion of rating scales discussed 
by Redhouse (1977) was used to measure 
outcomes in social skills* 

Personnel 

An A,T*U, Rehabilitation Science 
faculty member was director, the 
Behavioral Sciences Department chairman 
wad administrative co-director, the 
A.T.U, Director of Student Counseling 
and Development was reading consultant, 
and Che Director of Rehabilitation 
Science was vocational evaluation 
consultant. Four recent A.TtU» 
graduates and one A.T.U, undergraduate 
were employed as instructors, 
vocational eva.luator, and lab 
assistant • 

The YVDP assisted fourteen (lA) 
individuals or 5f>X of the 25 referred 
participants through the summer phase 
of the program and conducted pretests 
and poettests on the 14 Individuals in 
the areas of reading, iob seoklng 
skills* and social skills* A t-test waa 
performed to determine if the pretest 
group mean differed significantly from 
the posttest group mean on the reading 
test results, the Employabllity 
Maturity Interview test results, the 
.iob~8eeking flkills application form 
test results, and the criterion based 
behavior rating Mcnle. 

Reading pretext and posttest 
scores on the Nelson Denny Tests 
resulted in a mean score of 7,9 grade 
level pretest and a 9.957 grade level 
posttest. Results of analysis 
indicated that the participants did 
significantly better on the posttest 
than on the pretest, t(13) « 3*159, p < 
• 01 . 

Pretest and posttest scores on the 
Employabllity Maturity Intervie w 
resulted in a mean percentile rank 



score of 5 7 . 79 ptet<'>{L ami 8H.A:3 on 
posttest. Resultu of analysis 
fndl edited that the pn r L i c i pan r. did 
significantly bettor on the post Lest 
than on the pretest, t(13) - 5.10, p < 
.01 . 

Results of the scorfts on the Job 
seeking skills supplication form, which 
yielded percentage scores, showed a 
me an score of 53.71 pretest and 73.36 
posttest. Results of analysiiJ 
indicated that the participants did 
significantly better on the posttest 
than on the pretest, t(13) « 5.71, p < 
.01 • 

The criterion based behavior 
observation rating form waa used to 
rate participant behaviors based upon 
initial (pre) impressions about 
;;articpants and extended (post) 
impressions about participants. The 
participant's names were drawn by five 
YVDP staff members and rated on 
6/29/88. On 8/12/88, participants 
names who completed the program were 
drawn by two staff members. Responses 
were established as positive, neutral, 
or negative. A percentage score was 
obtained on the number of responses in 
each category and a t-test was 
performed on the difference between the 
means of the positive r«sponee of the 
observers from initial to extended 
impressions. Results of analysia 
indicated significantly more positive 
responses about participants from 
initial (pre) to extended (poat) 
impressions, t(12) - 5.36, p < ♦01. 

Of the 14 individuals who 
completed the YVDP summer phase, two 
enrolled in a vocational-technical 
school, one enlisted in the National 
Guard to get the GEO and training, 
three enrolled in adult basic education 
classes assisted by ARVAC/JTPA with 
worksites (of those, one plans to 
enroll in a vocational-technical school 
in January, 1989), one got the GED, has 
started a lob and plans to enlist in 
the National Guard, one got a Job and 
is supporting his family, one had a 
baby and plans to start 
vocational-technical school in 
approximately one year, one discovered 
that he had his high school diploma and 
stated he might get a job with local 
Industry, one has moved from the area 
and has be on roferrod to Arkansas 
Rehabilitation Services for assistance 
due to a physical disability, one has 
not responded to efforts to make 
contact although contacts with family 
provided information that he Is not 
working, does not wish to be referred 
to another agency and has not made 
contact with ARVAC/JTPA. and one 
enrolled In a vocational-technical 
school but dropped out. 

Twenty~fiv(! reports were submitted 
to the funding fl;(ency. Eleven of the 



ERIC 



195 



NATIONAL FORUM 



'211 



referred pa r l i c i pa n lh dropped out and 
did not hnve posttest scores in their 
reports. Rl«ht of tho 11 who dropped 
out hrtd significant pretejst information 
which provided an information base for 
cflBe management i;ervicefl in the event 
the individual applied for future 
ARVAC/JTPA services , 

Discussion 

As has been observed in various 
reports «nd studies (i.e, Wehlaj^e & 
Rutter, 1986; Grant Foundation, 1988; 
et al«) about dropouts, the 
participants (dropouts) enrolled in the 
YVDP facei? numerous economic, social, 
ed'icational and employment 
disadvantages • 

The characteristics of dropouts 
discussed in the literature and 
projected by a local high school 
counselor were quite accurate for the 
YVDP population. The problems which 
had led to their status becaine clear 
and sijsfnif leant as staff became more 
familiar with the participants. For 
example, it was easy for us to 
undorntand why a person was in trouble 
frequently or dldn»^. value or do well 
in school when we heard stories about: 
an incestuous r e 1 9 C i ons h i p ; havinj< been 
sexually abused by a step-father from a 
younr, i\fn*.\ luivinn to assume the 
responsibility of mothering 5-6 younger 
siblings when the participant waa only 
eleven; having to nursa a parent who 
had been shot by the other parent 
because of the death of a sibling in a 
traffic accident; suffering from 
delayed stress from having been the 
driver in 1 wreck in which a young 
person had been killed; having parents 
who had divorced when participant was 
U-12 years old; having to work because 
the parents lived on a meager fixed 
income; having a drug/alcohol problem 
so serious there was not enough time to 
discover the underlying reasons prior 
to being shipped off to another 
program; having people in the family 
who were mentally ill; having gone 
through all the grades prior to 
dropping out with a probable 
undiagnosed learning disability; and 
being hooked on drugs in the 6th grade 
because friends pressured to try some. 
It became evident that there was no 
simple, single reason for dropping out 
and any effective program cleai'ly 
needed to be able to address to a 
variety of problems . 

Of nhe 25 participants who started 
YVDP, fourteen participants completed 
the program with pre and post tests. 
Eleven participants dropped out prior 
to completion of the program. Four of 
the eleven youths who stopped attending 
YVDP were officially dropped on 7/5/88 
and the remaining seven were offlcialy 



dropped on 7/27/88, The eleven 
participants who did not complete the 
YVDP dropped out dm? to i\ variety of 
problems which Included: family 
problems (4 pa r t i c i pa n 1 0 ) , medical 
problems (1 participant), druj^ and 
alcohol problem (1 participant), 
financial problems (3 pa r t L c 1 pu n r « ) . 
needed to work (1 participant), program 
wasn't a GKD program as had been 
communicated (1 participant) and 
unknown (2 participants). Two 
participants stated more than one 
reason lor having dropped out. 

Significant data were collected 
and reported to ARVAC/JTPA about eight 
of the eleven participants who dropped 
out, Those eight participant reports 
incl.ded results from a battery of 
tests and measurements which provided 
biographical data, Information about 
reading skills, interest, performance 
X«Q.» job seeking skills, and initial 
impressions about participant social 
skills. Two of the eight reports also 
included an assessment of math skll'^, 
a report of the Vocational Personalxcv 
Profile and work samples measuring 
ability to make change and take 
personal messages. Behavioral 
observatloni? were also contributory to 
the reports as six of the eight were 
enrolled for more than two weeks in 
YVDP. Conaldorlng that traditional 
vocational evaluation programs provide 
an assessment report based upon a one 
to r.wo week evaluation (Vohiken, 1 987 ), 
the funding agency received signifi.-ant 
data on at least 22 of the summer YVDP 
participants . 

The pror:ram was viewed as 
successful In terms of average 
achievement by participanta who 
completed the program. Most 
participants were not only able to see 
impressive improvement from pretest to 
posttest scores but also established a 
Rroup identity. Each particpant left 
the program with more information than 
when they began and each participant 
had a vocational plan. Each 
participant was informed about 
follow-up contacts and made aware that 
they could contact the YVDP director 
for assistance. 

The first reporting i^eriod of 
follow-up showed that YVDP had either 
made or attempted 149 contacts with the 
participants who completed YVDP. At 
least two particpants had crisis 
situations which in my estimation would 
have resulted in dropping out liad not a 
major case management effort been taken 
by YVDP director and assistant in 
obtaining services to help meet basic 
needs . 

Recommendations for changes in 
YVDP included use of an occupational 
math program which would expose 
participants to math related to the 
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job, mo d 1 C i c a L I () n o C s o in o of the 
proKrara forms, restate mo nt of several 
p r o r a m >^ o a I s ♦ and a c c o p t a n c e of *3 0 
referrals to allow for attrition in an 
effor** to f*e,t 25 participants to 
continue the program through suTOmer* 
Discretionary funds were recommended as 
helpful In preventin>^ crisis situations 
and solving temporary financial crisis 
situations* 

Although YVUP was viewed as a 
successful program in having 
accomplished most goals, how does one 
assess tlie outcomes of such a program 
in relation to the funding agency's ' 
needs? What were/are the funding 
agency's needs « capabilities, and 
limita t ions ? 

The funding agency's stated need 
in requesting VVDP w^s that a 
vocational assessment was needed to 
direct services in terms of pi %q cement 
and training for the individual to help 
accomplish a vocational development 
plan. The funding agency's education 
and training services potential were 
initially stated as a broad capability 
ranging from job placement to college 
education which could be procured in 
various geographic locations. It was 
later determined that mostly local 
placement and training was possible 
with funding agency support. Although 
c o H (' g (J ti d u c a t i o n was initially stated 
to be a service option, it was later 
discovered to be a near impossibility 
with support from the funding agency. 
The funding agency was capable of 
providing purchase of books for adult 
basic education classes to help get tho 
GEO, could arrange and pay for 
worksites, paid hourly wages for 
participants enrolled in YVDP, could 
pay for vocational school training, and 
could provide support services such as 
child care costs, transportation costs, 
and assistance with utilities when the 
funds were available. 

The funding agency could not 
address issues such as the need for an 
eye examination and the purchase of 
glasses, assist with further 
specialised testing for a learning 
disability, respond quickly to 
financial crisis situations, pay for 
college education, nor easily provide 
training outside the local area, and 
could not easily mesh vocational 
assessment information obtained into a 
holistic approach of providing services 
to the individual participant. For 
example, there seemed to be an 
inability to recognize and respond to 
the urgency of financial crisis for 
individuals enrolled in vocational 
technical school who had limited 
opportunity to find work because of tho 
training schedule. In view of tlie 
funding agency's capabilities, 
limitations, and needs, it was 



e s t i m 4t t e d by this w r i t e i that having a 
professional vocational assessment from 
YVDP provided information ;uui a 
necessary foliow-througli commitment 
which the funding agency was not 
adequately prepared to handle. While 
the funding agency provided many 
valuable services, the emphasis seemed 
more geared to developing program ideas 
anil paying for the implementation of 
programs tather than being geared to 
casework services for individuals. 
While YVDP results indicated that tlie 
program was a valuable program for the 
high shcool dropouts who participated, 
an important aspect of the program 
included the assurance that the funding 
agency would help meet the training and 
placement needs of the indi. vidual. 
Meeting the training and placement 
needs of socially, economically, and 
educationally disadvantaged youth who 
completed YVDP required a major case 
management effort. It was not clear if 
the funding agency had a real need or a 
means (i.e. case manager) to address a 
ma.jor case management effort. 

Considering the special program 
capabilities and limitations of the 
funding agency, it appeared that 
participants enrolled in YVDP could 
have been served by funding agency 
programs already in existence, 
ilowovor, participants who completed the 
summer YVDP gained in reading, .job 
seeking skills, and social skills. Iney 
were provided an added chance program , 
as result of a cooperative effort 
between an Institution of high(»r 
education and a locnl community service 
agency. The potential for continuing 
individual growth and development of 
the YVDP participant exists as a result 
of tie cooperative effort in providing 
follcw-up services. While participants 
could have been served by existing 
ARVAC/JTPA programs without YVDP, they 
would not have recived significant 
achievement in instructional areas and 
ARVAC/JTPA would no have the 
significant vocational data about the 
individual. Also, the follow-up 
services provided thus far by YVDP are 
proving unquestionably invaluable to 
the total prograir effort. Without the 
major case management effort provided 
by YVDP, it is believed that 
participants would liave had great 
difficulty achieving their vocational 
goals, due in part to participants 
having a limited knowledge base about 
how to obtain needed Information and 
liow to utilize Information after 
obtaining it. In short, there is a 
need for intensive follow-up effort to 
Increase the likelihood of successful 
achievement of participant vocational 
goals established by the summer phase 
of YVDP. It could be stated that the 
real value of YVDP to the funding 
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a«ency has bo(jn the ability of the 
program to be adaptive and flexible in 
nn offort to rnc^t participant noods. 

While the YVDP was evaluated as a 
successful "added chance" program 
terras of meeting many goals and 
providing quality services to the 
funding agency^ are there other 
possibilities for such a program? 
Could the program be ad a p t e d ' f r o m 
added chance program to a preventive 
program in which a cooperative approach 
could be developed with the public 
school system? 

Similar to the conc€:pt of 
education for all handicapped children* 
all potential high school dropouts 
should be served with a program 
(Wehlagc & Rutter, 1-986) „hlch would 
allow there to continue and overcome the 
problems which lead to disruptions in 
the education process. The many 
characteristics of dropouts which have 
been identified are socially and 
economically handicapping just as 
having a physical .'ad/or mental 
disability is handicapping. 

It is clear that there is a 
nationwide push for approaches to 
prevent dropping out and to help tnose 
who have already dropped out. YVDP had 
characteristics identified In the 
literature (e.g. Ekstrom* et al.» 1986- 
Wehlage* et al. , 1986; Grant 
Foundat ion » 1 988 ; e t al . ) as 
imaginative. Innovative, and helpful to 
groups of pe.o: le who often feel 
alienated from the public school system 
to the extent that they are either in 
process of being pushed out or dropping 
out. 

From reviewing the literature, 
planning, developing. 1 mp 1 e rae n t i rr and 
expeilencinR YVDP. and observioK 
chanRes in YVDP participants (dropouts^ 
that cannot be quantified, it is this 
""^^wn? conclusion that a proRrara such 
aa YVDP could be a valuable preventive 
added chance, or intervention strategy' 
in addressing the problem of school 
dropouts . 

(For tables, appendices explaining 
various tests and/or forms used in 
YVDP. or more detailed information 
nJr^r"''' ^""tact MarKnret Wilkerson. 
WI>N 356 . Arkaiis,i.s Tech University 
Russellville. AR 7 230 1 . phone 
501-968-0283. ) 
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CONCURREhr; V/J.IDATION OF THE ABBREVIATED — — — * 
RCTARDATION AND LEARNING DISABILITI^ 



CHARmiTE M. KIMMEL, Ph.D. 



The purpose of this stidy was 
to investigate the concurrent validity 
of the Abbreviated McCorron-^Dial System 
(MDS) with special education students. 
^ Tlie sample consisted of 25 students 
with mental retardation and 25 students 
with learning disabilitie3. Each 
student was tested Individually with 
the four instnunents in the Abbreviated 
MDS which results in a prediction for 
vocational placement and a prediction 
for current earnings in the form of a 
percent of minimum wage. The criterion 
variables included three Valpar work 
samples and the actual current 
placement of the student. Correlation 
analyses used to examine the 
relationship between the Valpar percent 
and the MDS percent of minimum wage 
were high and significant. 
Correlations between the MD6 placement 
and actual placement were also high and 
significant. Multiple regression 
analyses revealed that the majority of 
the variance in both the placement and 
percent of minimum wage criterion 
variables was accounted for by one of 
the Abbreviated MDS instruments, the 
McCarron Assessment of Neuromuscular 
Development (MAND) . TTie MDS appears to 
be. a valid vocational instniment that 
can be used with p'oblic school students 
although, it provides better 
predictions for students with mental 
retardation than for students with 
learnii-ig disabilities. 



INTRCOUCTION 

One of the primary goals of public 
education ia to assist students in 
learning basic skills so they can 
become productive members of our 
society. Vocational education is an 
important part of this process (Brolin, 
1982) . Recent legislation has ensured 
that special needs learners will have 
access to vocational education. The 
first step to appropriate vocational 
placement for these students is 
vocational assessment to determine 
skills, aptitudes, and interests in 
order that appropriate instruction and 
training can be provided, 

One of the assessment instruments 
frequently used with special education 
students, and the vocational evaluation 
system roost preferred by Texas 
vocational evaluators according to a 
1981 survey (Ludlow & McGlasson, 1982), 
is the McCarronHDial System (MDS) 
(McCarron & Dial, 1986). 

The Abbreviated MDS consists 
of a battery of tests grouped into 
three factor areas. The three factor 
areas and the instruments used in each 
factor are: (a) The verba 1 --spatial- 
cognitive factor measured by the 
Peabody Picture Vocabulary Test-Revised 
(PPVT-R) (Dunn & Dunn, 198' (b) the 
sensory factor measured by the Bender 
Visual Motor (festal t (BVMGT) (Bender. 
1938), and the Haptic Visual 
Discrimination Test (HVET) (McCarron & 
Dial, 1975a); and (c) the motor factor 
measured by the McCarron Assessment of 
Neuromuscular Development (MAf4D) 
(McCarron, 1975) . 

Only one research study was found 
which used students in public school 
settings. The purpose of this study is 
to investigate the concurrent validity 
of the Abbreviated MDS with students 
who are mentally retarded or learning 
disabled in the public school system. 

Research Questions 



Research questions addressed by 
this study Include: 

1. What is the relationship 
between the predicted program level of 
the handicapped student obtained using 
th<? previously validated Abbreviated 
MDS regression equation aixi the actual 
program level of the handicapped 
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2. What is the relationship 
between each (and all) of the four 
variable scores in the Abbreviated MD6 
and the actual program level of the 
handicapped student? 

3. Vfhat is the relationship 
between the percent of minimum wage 
obtained using the previously validated 
Abbreviated MDB regression equation and 

the estimated percent of minimum 
wage obtained by work sample analysis? 

4. What is the relationship 
between each (anl all) of the four 
variable scores in the Abbreviated MDS 
and the estimated percent of minimum 
wage obtained by vfork sample analysis? 

McCARRO>H)IAL fflSTEH - \JSSS iD 
mucatlonal Settings 

, A variety of articles advocate the 
use of the MDB In the public schools 
(Botterbusch, 1987; Dial & Henke, 1981; 
McCarron & Dial, 1980, 1986) or 
describe ways it may help in meeting 
the guidelines for vocational 
assessment in the schools. In a review 
of vocational evaluation systems/ 
Botterbusch (1987) reported that the 
MD8 can be used with special education 
populations including mentally retarded 
and learning disabled fstudents 

Since 1980, McCarron and Dial have 
advocated the use of the MDO in 
educational and school settings, Two 
uses of the MDS In schools are for 
individual programming about work 
criteria with students who have 
moderate to severe developmental 
disabilities or for pupil appraisal of 
younger learning disabled or 
developmental ly disabled. children 
(McCarron and Dial, 1980) . Dial and 
Henke (1981) described procedures for 
developing the individual evaluation 
and program plan using a school-^ged 
student as the case study. 

Several other articles have 
described how educational settings are 
actually using the MDS with their 
students. Patton (1981) advocates 
using the MDS to develop vocational 
objectives in the Individual EMication 
Plan (lEP). While Whitaker (1982) 
recommends using the MDS as a 
prevocational scireening technique with 
handicapped students to provide the 
vocational teacher with an estimate of 
vocat iona 1 -psychol ogi ca 1-neuro 1 ogi ca 1 

potential of the student. 

The MDS has also been used to 
-iissess general vocational ability and 
develop vocational programming with 
learning disabled or mentally retarded 



inmates, who qualified for special 
education services, while incarcerated 
in a minimal security federal 
correctional institution (Piatt, 
l\Anick, & Wienke, 1982). Shainline 
(1984) described the vocational 
assessment labe used in the Albuquerque 
Public Schools in Albuquerque, New 
Mexico which were equipped with the MDS 
and other vocational instruments in 
order to evaluate students at their 
high schools and assess vocational 
potential. Henke (1980) described how 
the MDS can provide a 
neuropsychological understanding of 
learning disabled students' abilities 
and prevent their inappropriate 
employment. 

A research study completed by 
Hegenauer (1986) showed the 
relations! lip between MDS scores and 
vocational expectations of pai^ents, 
teacher?!, and work supervisoif^s of 
learning handicapped students. This Is 
the only research-based article that 
describes the use of the MDS in the 
public schools. While approximately 
1000 schools have purchased the MDS and. 
use it for vocational assessment, no 
other published articles could be 
located whidi discussed its use in the 
pul^lic school system. 

Subjects 

The subjects included in this 
study were 50 special education 
students [25 students diagnosecA as 
mentally retarded (MR) and 25 ntudents 
diagnosed as learning disabled (ID) 1 
who were 16 years jf age or older and 
currently enrolled or seeking placement 
in public school vocational education 
programs, The students were chosen 
from the files of two special education 
departments in suburban, predominantly 
middle class, white school districts in 
the Houston metropolitan area. Tfie 
s-abjects ranged in age from 16 to 20 
and were enrolled in grades 9 throtvjh 
12 during the data collection period. 
The meein If) for the total sample wqh 
69.9, with a range from 28 to 106. 

Instruments 

Each stixient was evaluated iisincy 
the Abbreviated McCarronrDial System to 
obtain a prediction of vocational 
placement and estimation of cun^ent 
percent of minimum wage. Three Valpar 
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Component Work Samples (Valpar 1, Small 
Tools; Valpar 8, Simulated Assembly; 
Valpar 11, E/e-Hand-Foot 0>Drdinatlon) 
were chosen as one criterion variable 
because it can be compared easily with 
the MD8 percent of minimum wage. The 
other criterion variable, actual 
placement level, was determined by 
interviewing the student and special 
education teacher, reviewing student 
records, and checking student class 
schedules. This Information was 
provided to two outside raters who 
designated the current program level of 
the student according to the five MD8 
placement levels? Level 1, 
Daycare/Basic Skills which provides 
constexnt suparvlsion and teaches self 
help akillsi Level 2, Work 
Act'lvity/8eu9lc F^revocational training 
which involveo using arts, crafts, and 
simple work ta£«k« in a structured 
env-lronownt; Lcrv«l 3, Ebctended 
Sheltered Training/Advanced 
Pre^/ocational Tftraining wher^ students 
perfojTR work tasks to elicit behavior 
change and hai>il.itationj Lev^l 4, 
Transitional Traininj/Voc^tlonftl 
Readiness which provides temporary 
training includlr^ personal-ftoclal and 
work adjustment; and Level 5, Caaaunlty 
aaployiTient/Vocational Bluaation where 
the student current iy hajS5 a comrounlty 
job or vocational education pnygi-am. 

Intiwrater reHa)M lity between tJ*ie 
tw rateit^ used in detmnining the 
plao»i»cnt Iwols for the student*) in 
thi« study waa- aod€«rately higt'i (.138). 
Mien th^uve \^ a disagrcHDmer^t about the 
level, the two raterfii we.r« wver wore 
thcvn one apart. After discussion 
between th^^ two raters tlwy w»r« always 
iVJ:)le to n»acjh comsensfua . 

llM) miSiW of the tmr MDS 
r^redictor v«i?»"iable^s a?*e; PPVM^»«63.86, 
0VW/r«»71.50. MVDT«73,t5J!. ami 
MANP-76.02. These mm gt^neraUy 
fall )i*»tv\aen tlie mean of the 
I'ieuropwycholcgically distttbled gnxjp 
(mean^55) aM the mmw of the normal 
population (mean'-'lOO) , 

ViTilparfii 1. fl.. etriA ii Total wore 
wighttwl eq\Hny to obtain the A% 
[actmi petx^nt. of ftlrvlmurD wage) 
a:nteriic)n vtivr.tttble for each 5u.bject. 



Scores near 100* represent perfonnance 
comparable to an entry level worker. 
The means are: Valpar 1 - 42.24, Valpar 
8 - 39.08, and Valpar 11 Total - 86,16; 
and a total Valpar a^ean of 55.94. 

Research a^estions 

The first research question 
examines the relationship between the 
MDS predicted program level of the 
handicapped student and the actual 
program level of the handicapped 
students obtained through rater 
consensus. There is a high significant 
correlation between the MDS placement 
levels and the actual placement level 
of the handicapped students (r«.84, 
E<.0001). 

The second research question was 
answered by examining the 
Intercorrelations between the predictor 
variables and the actual placement and 
by conducting a multiple regression 
analysis to obtain the total 
relationships between each of the four 
variables and the actual placement 
level of the handicapped student. 
There was a significant correlation 
(JS<,0001) between each of the predictor 
variables and the placement criterion 
variable. The results of the multiple 
regression analysis reveal that the H- 
Squares for all four variables were 
significant for the total sample (.75, 
E<.0001) and that the MAND accounts for 
all hit 5% of the variance in the total 
sample. 

The third research question 
examines the relationship between the 
MDS percent of minimum wage and the 
Valpar estimated percent of minimum 
wage. The results reveal a slgrlf leant 
correlation (p-.81, e<.0001). 

The final question was answered by 
exploring the Intercorrelatiorw between 
the MDS variables and the Valpar 
percent of minittfum wage and by using a 
multiple regression analysis to 
datermlne the total relationship 
b«»tween each of the four variable 
scores and the actuil percent of 
minimum wage of the handicaKWl 
fl^tudent. All correlations for the 
total samt)le were significant at the 
^.0001 levrl. The highest significant 
carrel at ion was between the MAND and 
the actual percent of minimum wage 
(.88), The R-Squares for all four 
variables were significant 
(.78,p<.0001), and the MAND accounts 
for the greatest amount of variance 
(.77). 
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CONCLUSIONS 

1. MDS placement levels appeeur 
valid due to the high correlations 
•jetween them and the actual placements. 

2. The high correlations between 
the MDS percent of minimum wage and the 
three Valpar components provides 
evidence for their validity, 

3. The MDS predicted placement of 
MR and LD students well beyond chance. 

4. Placement and earnings predictions 
were more accurate for MR than for ID 
students . 

5. The HAND could be used alone to 
determine placement without much loss 
in predictiveness. 

6. The MDS predicted current 
percent of minimum wage, as measured by 
the Valpar work samples, for the MR and 
LD. students well beyond chance. 

7. The MAND could be used alone to 
determine earnings without much loss in 
predict iveness, for MR and LD students. 

8. The MDS appears to be a valid 
vocational assessment instnjment that 
can be used with MR and LD students, 
although it provides better predictions 
for the MR student, 
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USE OF A ROBOTIC SVSTEH IN VOCATIONAL ASSESSMENT: EXPLORATORY STUDY 
S, ROBBINS, OTR, ^ -R. ^ 

R. ERLANDSON, Ph.D.; K. KRISTY r a 
METROPOLITAN CENTER FOR HIGH TE?HNo£6g? DETROIT 



Abstract 

Whether they are called a 
manipulator, robot workstation or 
^v^?!i° "^'abilitation robotiJ 

systems now under development aim to 

a^S'iSnction'"'? '° ^^'""^^ ^^"hoS? 

arm function, in order to make it possi- 
ble for them to perform ADL, vocational 

t^J?Jf - i™?® ^ rehabili- 

tative testing, evaluation and treat- 

llslkd currently being 

iaefn? "^'^^ic system that may be 

useful in some aspects of voca- tional 
assessment. The system con- sists of ?he 
following: ibm-FC com- puter „itb 
sJsfem"' robot'^monito^ing 
withfn fhl rSr^o?^ computer resident 
within the IBM-PC); two touch-sensitive 
buttons, one on the robot arm ("target"? 

"e'^t to the subject 
("home pad"), with this set-up, various 
determina- tions can be made: 

- anthropometric mapping: what is 
the size of the wotk envelope of 
the subject? 

- endurance: what is the subject's 
capacity for repeated movements 
(near the trunk, at the extremes 
ot his/her work envelope, or 
traveling between these points) , 
at high speed bursts or substained 
over a longer time? 

e^i?inn™°.n- "^^^^'^ ^" ^he clinical 
environment are now under way. They aim 
to determine the quality of the system as 
constructed, the usefulness ^oftSI 
information it provides to the voca- 
tional evaluator, and the possibilities 
for expanding the system. Also dIsoassS 
are the rationale for and design ot the 
system and its current applications the 
results of the field trials, and the 

rf?S?? • ""^^ °^ robotics in 

rehabiiitive testing and evaluation in 

^aJucila?'^ vocational assessment in 



~5r 



20 



Introducti nn 

r. robot is a machine that, under 
^vnrfK receives information 

from the environment through stnsory 
Mn^^^^ jffeling, vision, hearing^, 
"interprets" that information, and 
interacts with the environment based on 
til °"^-u Although we are not at 

the level in robotics technology that is 
ttJ^ t science fiction movies such as 
seJ l^rl- °/ Short Circuit, robots are 
^kL ^ machines because 

J"-^" receive sensory input and act 
according to that input. 

an m"°^J'„ consist of a base with 

^^nonnf """-^^ various attachments, 
co^^^ni ^ on the application, and 4 
control computer. In industry, robots 

«oi^/n ^^""l^ P*^"*'' ^° assembly and 
sorting work, etc. in the field of health 
care, robots are being used in a number 
cT,v.^r° f^^"** applications, including 
surgical assistants, laboratory 
technicians, and transporters for trav 
delivery and other menial tasks (cf. 
Engelhardt, 1986). ^ 

^ho introduced into 

the field of rehabilitation as mechani- 
cal personal care attendants (PCAs) . or 
smart aids. The Case Institute of 
Technology developed the Case Manipula- 
tor a "computerized orthosis", in the 
diffLini-'"'^' ^"^""tly, at least nlnl 
different groups in five countries are at 
work on further development of what is 
variously called a robotic aid, manipulj! 
H.^f4«„ ^ ^ °^ ''^^^ Station. (See 

?ch™!y ^"'^ "^^y^"^' Seamone anS 

Schmeisser, i985; Leifer et al., 1987; 

al iS^v^'p''' Harwin et 

al., 1987; Fu, 1985; Anderson, 1987) 

nrp™<^ii ^''^f^® projects have different 
premises and goals. The robots are in 
different stages of development; the 
only one being marketed commercially (as 
tLi.^ ^r^*'^"^^ the Boeing Jork- 

voic.°" .1?' .'^''^ P^'^^ Command, a 

3h,Vh J^''^*^^^ personal workstation 
which makes it possible for a quadri- 
plegic to perform many clerical and 
managerial jobs. The Johns Hopkins^'robS? 
co^^^nf capabilities (with chin 

"k^'^'u input) an" 

also can brush teeth and feed (Husa 
and Taylor, 1987). The Stanford ^SSotic 
aid can do selected activities of daily 
living, other features under development 
^" ^^^^°n. in the Spartacus project 

<^^rn%^' ^ ^"'^ mobility, i^ ^the 

Stanford project (Leifer, I987b) 

It is likely that in the near 
future rehabilitation robot aids will b^ 
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mobile, have vision systems and speech 
input/ output, and will perform a large 
number of tasks in the home and work- 
place. Whether they will be affordable 
and acceptable to people witn a dis- 
ability is unknown. 

Robots as rehabiU ^^^^Q^ aides 

Given the work underway on robotic 
ttystems that provide assistance in ADL, 
vocational, and recreational tasks, our 
project took a different approach: the 
robot as a tool in evaluation and 
treatment in rehabilitation. Therapeutic 
applications of robots in rehabilitation 
were previously developed by Khalili and 
Zomlefer (1988), who constructed a 
continous passive motion robot; the 
Cambridge group, which built a 
manipulator to assist in the 
developmental education of young children 
with severe physical impairments (Harwin 
et al», 1987); and Engelh&rdt and 
colleagues^ who piloted robots for range 
of motion of wrists and ankles 
(Engelhardt , personal communication, 
1988) • Hovrever, it appears that none of 
these applications has gone as far as 
ours in using the ability of robots to 
"sense", ••think" and ••act". 

The purpose of our initial three- 
year project was to explore to what 
degree a robot can be used in the field 
of rehabilitation for physical 
disability^ as an aide to or tool used by 
therapists in testing and treating 
patients. 

Much of therapy provided by 
occupational and physical therapists 
consists of showing a patient (new) 
movements, guiding him or her through 
them, providing feedback on adequacy of 
performance I and then encouraging the 
patient to repeat the movement or task 
until it has been mastered or the 
therapeutic effect has been accomplished. 
These are all things a robot can do, 
given the necessary software and hardware 
attachments. In principle, a robot system 
has many advantages over a therapist: 

- It never tires, and is available 
24 hours a day, seven days a week, 
without over-time payment; 

- It never gets bored; it repeats 
the same movements with ^^uaiii- 
mity and without burnout; 

- It is never distracted; it 
maintains its level of concen- 
tration and diligence con- 
tinuously. 

There are, of course, disad-- 
vantages. Even the most advanced robot 
cannot offer solutions to unique patient 
or situational problems, and is unable 
to observe the patient's pain, dis- 
comfort, refusal to cooperate, or other 
problems, and act accordingly. That means 
that for patients with compromised compe- 
tence (e.g. after stroke or traumatic 



brain injury) , a therapist should be at 
hand. However, if the robotic system is 
designed in such a way that it cannot 
harm the patient, it appears possible for 
ona therapist to monitor several robots, 
each ••administering" therapy to one 
patient. 

Formal testing of a patient by 
rehabilitive therapists is performed as 
part of initial assessment, and repeated 
at intervals during the course of treat- 
ment. More and more, the trend is toward 
objective quantitative testing.. Measures 
like grip strength and walking speed are 
collected using simple instruments; but 
clinics nowadays are also using sophisti- 
cated equipment like microcomputers 
hooked up to isometric exercise machines 
or to gait recording equipment. This 
development is driven by the availability 
of technology, but also by the need to 
provide a scientific basis for practice, 
and issues of accountability: third 
party payors increasingly want written , 
quantitative evidence of progress and 
outcomes of rehabilitive treatment. In 
much of the new technology available to 
therapists, the distinction between 
testing materials and exercise equipment 
has disappeared: the machine provides 
continous quantitative and graphic 
fee'iback of the patient's performance 
wh.Ue he completes a treatment program. 
That is true for e.g. the Cybex and BTE, 
and the same potential exist for robotic 
systems. This adds to the potential for 
cost savings. 

The opportunity for cost savings 
was one incentive behind our project • 
With demands from third party payors for 
increased contact time, and for perfor- 
mance improvement at lower cost and in 
shorter time, rehabilitation facilities 
must find innovative means for delivering 
qual ity therapeutic treatments without 
increasing staffs or budgets. Robots can 
contribute to greater efficiency, if one 
therapist can treat several patients at 
once. Even with minimal cost savings, a 
robotic system has possible advantages , 
including the capacity to count and to 
time patient activity ir great detail, 
giving the possibility of producing 
objective and detailed reports of patient 
performance. The objective monitoring of 
patient progress, and the pinpointing of 
problem areas, will contribute to quality 
therapy . 

Syg^j^em design and use Ln strpke 

treatment 

Since stroke patients are a large 
part of the population in any rehabili- 
tation setting, this group was selected 
for the initial study which focused on 
motor recovery. To implement movement 
patterns in the early stages of recovery 
after stroke, the therapist may move the 
affected upper extremity through a 
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variety of therapeutic patterns. in 
later stages^ therapist assistance is 
decreased as the patient begins to move 
his limb more independently. Movement 
patterns increase in complexity as the 
patient progresses. Activities to 
facilitate these movement patterns may 
include touching objects at specific 
points in space as directed by the 
thevapist. The specific points vary in 
direction and height depending on 
individual needs. 

The research team decided to develop 
a robotic system to simulate the OT 
providing upper extremity reeducation 
for stroke patients (Creighton, 1987; 
Kristy, 1988) . The robotic arm exercise 
system (Figure 1) consists of the UMI, 
Inc. RTX robotic arm (1), an IBM-PC 
computer (2), printer (4), Robot Moni- 
toring system (RMS), specially designed 
end-effector (7), and a "home" pad (5), 
The system computer controls the robot's 
movements. The RMS, actually a second 
computer system designed to fit in the 
IBM--PC computer, monitors and controls 
the end-effector and home switch sensors/ 
indicators. The system's computer monitor 
displays exercise status information 
during the course of the exercise task. 
The printer provides a hard copy report 
for the therapist or patient. During a 
therapy session, the patient sits in a 
wheelchair (6) to touch the home pad (5) 
and the touch pad (7) on the robot's end-* 



effector* To start the session, the 
patient touches the home switch to in- 
dicate that he/she is ready to begin. 
The robot arm then moves the end effector 
to a point in space and stops. An in- 
dicator light on the end-effector lights 
up, indicating that the patient should 
touch the corresponding pad. The patient 
touches the pad and the system responds 
by turning off the associated indicator 
light and turning on the home switch in- 
dicator light, signaling a return to the 
home switch. 

Two modes are used. The Wait mode 
allows the patient to work at his/her own 
speed; the robot literally waits for the 
patient to respond by touching the end- 
effector before moving to the next point 
in space* The Pace mode requires the 
patient to work at one of four pre- 
determined speeds, from relatively slow 
to relatively fast. This mode represents 
a greater challenge to the recovering 
patient's motor ability. 

Many variations are possible to 
this basic theme. The end-effectors can 
be changed to carry one of a variety of 
touch pads , ob j ect receptacles , etc . 
Likewise, the home switch can be any one 
of a similar variety of sensors or touch 
pads. IJlSJssyJjtfii^^ 
rgquir^d pec fgrm ^.^ fiiven mpygpiept or 
tMk as promptecji tpy th? end-ef f ec^t^og ^pd 
hgmg..,>^tgh i-r)<jlj,patQr.J..iahta. The system 
monitors the patient's responses, and 
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records data regarding timing, latencies, 
switch-to-switch movements, overall task 
time, etc. 

For instance, we are currently 
working on an application in which a 
stroke patient in a more advanced stage 
of recovery is required to pick up an 
object from a delivery system, and insert 
it in the robot's gripper, which may be 
at a specified point in space, and have a 
specified orientation. The objects are 
select ^ to require various grips and 
pinches (lateral, spherical, etc.)* On 
the drawing board are various applica- 
tions for testing and treatment of upper 
extremity coordination problems, modelled 
on currently existing equipment e.g. 
inserting pegr, screwing nuts and bolts. 

A study was conducted to determine 
whether the robot system developed for 
stroke movement therapy was safe for 
patient and therapist, and acceptable to 
both of them. Data on use of the system 
over a period of five months, with 11 
therapists treating 22 patients, suggest 
that robotic arm use in treatment and 
evaluation is safe. We did not experience 
a single incident, nor did therapists 
express fears of accidents. All of the 
patients who completed a feedback form 
felt safe. Even though many of them were 
elderly, with a limited education, and 
cognitivoly compromised, they seemed 
intrigued by the system. Many expressed 
enjoyment working v/ith it, and made other 
comments indicating that they accept 
receiving treatment from a machine. 

Vocational asse ssment application 

The Work Hardening program of 
Rehabilitation Institute became involved 
in this project to see if the system 
could be used in vocational assessment. 
Our question was: With this set up, car 
the vocational evaluator make various 
determinations about the physical 
capability of the individual being 
considered for a job (whether first- 
time entry or return after injury) . 
The hardware developed for the stroke 
moveinent pattern therapy was kept; 
however, we developed new software re- 
quired to irake determinations of interest 
to vocational evaluators, especially 
involving patients considering manual 
jobs. Specifically, with this new soft- 
ware the robot can perform: 

- Anthropometric mapping: what is 
the size of the work envelope of 
the subject? Can the patient per- 
form all movements necersary in 
the job? 

This is determined by a program which 
moves the robot arm systematically 
through a IdO degree arc in front of the 
patient; The patient is required to touch 
the sensor at specific intervals. By 
plotting which points (at what heights 
and distances from the trunk) the patient 



can reach, the computer can provide a de- 
tailed quantitative overview of the work 
envelope. 

- Endurance testing: what is the 
subject 's capacity for repeated 
movements (near thetrunk, at the 
extremes of his/her work station, 
or traveling between these points) , 
at high speed bursts substained 
over a longer time? 
Capacity for repeated movements at high 
speed is determined by requiring the 
subject to do tapping; the system 
determines how many taps he accomplishes 
within a twenty--second interval. This is 
a modern version of a test that e.g. 
neurologists have used for many years . 
However, with the robot the touch pad can 
be automatically positioned at any point 
in space, whether near the trunk or at 
the extreme of the subject's work enve- 
lope. The program can also require taps 
alternating between home plate and end 
effector. If this same movememt is re- 
quired at lower intensity but over a 
longer time period (e.g. 15 minutes) , it 
is an excellent test of endurance for the 
repeated movements required in many in- 
dustrial jobs, such as assembly. 

Future potential 

We foresee even more sophisticated 
uses of robotics in vocational evalua- 
'^ion* For instance, robots may be used to 
simulate assembly and other jobs: the 
robot could hand the subject a partially 
completed subassembly every 30 seconds; 
he is required to retrieve two parts from 
a bin and properly place them; he then 
hands the part back to the robot, which 
inspects the item. The advantage of a 
robot system in that many jobs can be 
simulated very flexibly, and the relevant 
parameters of job performance (speed, 
reach required, etc. ) can be modified 
from the keyboard. The ability of the 
system to inspect, count and time only 
adds to its potential. 

A second application might be in 
the custom design of work stations to 
fit the physical abilities (range of 
motion, strength, endurance, etc.) of 
return-to-work candidates, both in manual 
and white-collar occupations. "Where 
should the shelf with reference manuals 
be positioned so that the subject can 
retrieve and reshelf a three-pound 
volume at least three times an hour?" 
Answers to such questions can be obtained 
using computer intelligence, which would 
free up much time of the vocational 
evaluator. 

These are just first steps toward 
the "employment" of robots in the field 
of vocational assessment. However, given 
the basic robotic capabilities available 
with current technology, the needs of the 
rehabilitation field, and the example of 
other technological developments (e.c,. 
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the Cybex and other isometi-ic exercise 
machines, and microcomputers as thera- 
peutic and testing aids), we foresee a 
future fully developed robot rehabili- 
tation aide that is characterized by a 
number of features, including the 
following: 

- Multifunctional: using a variety 
of attachments, the system can be 
used with various diagnostic 
groups. Testing applications 
might include: measuring range of 
motion , endurance . strength , 
sitting balance, etc; assessing 
cognitive deficits like hemi- 
neglect and decreased attention 
span; anthropometric mapping; 
selection of adapted worksite 
equipment; job selection and 
environmental modifications. 

- Easily customized programs, out- 
puts and reports. 

- Voice output for instructions 
and encouragement to patients. 

- Input by means of voice and/or 
a touch-sensitive screen. 

- Comprehensive reports ( including 
graphic presentatation of infor- 
mation) on the results of a 
particular session; time trends 
and normal values can be dis- 
played . 

Discussion 

The field trial of the current, 
limited vocational assessment application 
(anthropometric mapping, endurance 
testing) is in an early stage, and no 
systematic, quantitative data are avail- 
able from this pilot or proof-of-concepf 
study. However, based on the impressions 
of the investigators and other staff, the 
following may be offered as early con- 
clusions: 

- The system is safe to client and 
staff evaluator. 

- Given the demensions of the RTX 
robot arm, realistic anthro- 
pometric mapping is not possible, 
without repositioning the subject 
several times. A longer arm that 
has a larger (WxDxH) envelope is 
necessary. 

- A larger arm is also likely to 
have a higher "pay load**, 
allowing for many tests of 
coordination and strength that 
are not possible with the 
current model. Many of these 
tcists are necessary for com- 
prehensive assessment. 

- Further study is necessary to 
determine whether there are 
real benefits to using a robot 
system rather than simpler 
existing equipment that is 
available for evaluation. The 
capacity for repeated semi- 
independent action that makes a 



robot so useful for tnerapy 
applications is much less useful 
in evaluation applications. 
Clearly, a conclusion as to the 
utility of a robot system in 
vocational evaluation cannot be 
drawn until additional test huve 
been implemented. While a system 
offering one or two tests may be 
of little value, a multifunc- 
tional system, especially if 
equipped with some artificial 
intell igence or expert system , 
offers better chances of being 
acceptable to vocational 
evaluators. 
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Abstract 

The aptlti'de scores produced by the 
NicrocoMputer Evaauation Screeninip and 
Attesanent (MBSA) were exawlned in terns of 
their construct and criterion-related validity. 
Construct validity was exaninad by conparln? the 
aptitude scores of 29 displaced workers who had 
conpleted both the MESA and the General Aptitude 
Test Battery (GATB). Criterion-related validity 
Mas exaiiined by coaparing MESA aptitude scores 
with the Occupational Aptitude Pattern (OAP) 
multiple cut-off scores of 12 participants who 
had achieved tenure in their last occupation. 
Little evidence was found to support either the 
MESA'S construct or criterion-related validity. 
Inplicationa are briefly discussed. 



A recent trend in rehabilitation settings 
!• the growth of co»puter-ba«ed assessment 
(Burkhead A Sampson, 1985; Sampson, 1983), 
Rehabilitation facilities arc increasingly using 
computer-based assessmert systems and, as a 
result, vocational evaluators increasingly have 
client scores and other performance data 
available from computer-based assessjuent to 
facilitate client vocational choice and case 
service decisions. Since the advent of computer- 
based evaluation systems is recent, there is 
little data available regarding their 
measurement properties, particularly* validity. 
Such information is needed to assis: vocational 
evaluators in making appropriate inferences from 
the assessment data generated. 

One of the most popular of the computer- 
based systems is the Microcomputer Evaluation 
Screening and Assessment (MESA) system (Pry, 
1984 i Valpar International, 1984), As Indicated 
in its title, the MESA system is designed for 
evaluation and screening, its stated purpose is 
"to assist in identifying those individuals who 
are job or training ready, those who are in need 
of remediation, or those who may need a more 
comprehensive assessment" (valpar 
International, 1984. p, 67), The MESA system 
was introduced by the Valpar In;:ernational 
Corporation in 1982 and. according to P. 
Rpthstatter, Valpar National Sales 
Representative (personal communication, May 17, 
1988). the system has been sold to more than 
1,800 rehabilitation facilities, schools, 
private pra<;titioner8, and other rehabilitation- 
related facilities in the United Stntes, Thus, 
a sizable number of vocational evaluators have 
access to and use the MESA system as part of 
their vocational evaluations. 

Despite its widespread use, only limited 
research has examined the measurement properties 
of scores produced by the MESA system. The MESA 
manual (Valpar Internation' ! , 1984) reports one 
reliability study with encouraging test-retest 
estimates over 4-week intervals for 22 subtest 
scores. Reliability coefficients varied from 
.79 to .96, with 16 of the 22 coefficients In 
the .90 '8, The MESA manual emphasizes the 
Importance of content validity, and provides 
comprehentjlve analyses of Vocabulary, Spelling, 
and Math subtests in terms of frequencies of 
word usage and levels of difficulty relative to 
commonly used standardized achievement tests: 
however, little other data regarding validity 
are reported. In reviewing the MESA system. 
Botterbusch (1987) states that 

Validation presents a serious problem.... 
The two manuals contain no studies where 
the MESA was validated against outside 
criteria such ns prediction of training or 
Job success, in aQiltion. given the 
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developer's emphasis on construct validity, 
no factor analysis results or correlations 
with other tests, work samples, etc. for 
the various subtests are reported (p. 73), 
Or:.- brief account ot "MESA Research 
Highlights" has been published in the "Valpar- 
Spective" newsletter (Valpnr International, Fall 
1985), and the results are said to indicate that 
"MKSA is doing the job it was designed to do" 
(p. 6). The results reported, however, are 
sketchy and dilificult to interpret as they 
relate to validity and appear to lend little 
support to that statement. What would appear to 
be tho most encouraging finding was that 
"employed workers had 86\ of their Worker 
Qualifications Profile Level scores equal to 
higher than the Worker Qualifications Profile 
requirements of their Jobs" (p. 6); however, no 
further information is provided regarding the 
methodology or results of that study. 

It appears that no other research has been 
conducted on the MESA system. In reviewing the 
system, Botterbusch (1967) cited no research 
other than that reported in the MESA manual. A 
computer search of the Psychological Abstracts, 
ERIC, and National Rehabilitation Information 
Center (NRIC) databases as well as telephone 
contact with Valpar International Corporation, 
identified no additional research reports 
published on the MESA system. Thus, vocational 
evaluators who use asaessaent information from 
the MESA system in determining vocational 
potential, have very little empirical support 
for the relevance of that information ^or 
determinations and decisions to be made. 

The purpose of the present study was to add 
t'j the limited data available regarding the 
validity of MESA aptitude scores. Construct 
validity was examined by comparing MESA aptitude 
scores attained by a sample of previously 
successful workers, who had since been 
"displaced" from their jobs, to their scores on 
General Aptitude Test Battery (GATB) aptitudes. 
In addition, criterion-related validity was 
assessed by examining the extent m which MESA 
aptitude scores would have met multiple cut-off 
^criterla indicative of succosa in occupations in 
which the workers had, in fact, previously 
achieved successful job tenure. 

Method 

Participants 

The sample was compris^^d of 29 individuals 
who were unemployed and participating in one of 
two programs for displaced workers sponsored by 
vocational-technical schools in the upper 
Midwest. Of thn Z9 participants, 19 (65.5*) 
were male, and ages rang- d from 23 to 61 (M - 
40.2, SO - 11.1)' In trrms of education 
compinted. 28 (96.6!t) had completed hlRh school 
and 9 (31.05^) had completed some post secondary 
traininvj. AJ 1 had been employed In thnlr 
previous positions for at least one year (M - 



4.6, SD = 2.3). Occupational calef^orios 
represented by their immediately previous 
positions included clerical and sales (?7.6*); 
machine trades (21.6%)\ professional, technical 
and managerial (17.2*); and bencbwork, 
structural, processing or miscellaneous (27.6*). 

Instrumentation 

MESA system . As summarized by Botterbusch 
(1987), the MESA system is comprised of multiple 
subtests in each of nine major categories: (a) 
Hardware Screening; (b) Physical Capacities and 
Mobility Evaluation; (c) Vocational Interest 
Screening; (d) Vocational Awareness ScrecninK: 

(e) Independent Perceptual Screening Assessment; 

(f) Talking-Persuasive Screening; (g) Working 
Conditions-Environmental ^reference; and (1) 
Computer Screening Exercises (the final category 
la comprised of 13 exercises). All subtests 
combined yield 84 items of information which are 
designed to assess client characteristics 
related to vocational potential, with an 
emphasis on those identified in Worker 
Qualifications Profiles (WQPs) defined by the 
United States Department of Labor. Among the 
characteristics for which scores are derived are 
aptitudes, academic achievement, physical 
capacities, vocational interests, and vocational 
awareness . 

Aptitude scores, the focus of the present 
study. Include the 11 WQP aptitudes in the 
following areas: Intelligence or General 
Learning (G), Verbal (V), Numerical (N), Spatial 
(S), Form Perception (P), Clerical Perception 
(Q), Motor Coordination (K) , Finger Dexterity 
(F), Manual Dexterity (M), Eye-Hand-Foot 
Coordination (E). and Color Discrimination (C). 
With the exception of the N, C, and E aptitude 
scores which are each based on only one MESA 
subtest, at least three subtests contribute to 
each of the remaining aptitude scores, with six 
or more subtests contributing to five of the 
scores . 

Aptitude scores on the MESA correspond to 
the l-to-5 WQP aptitude levels, ranglr.r from the 
highest to lowest standing relative to the 
general population. However, since the MESA is 
not designed to assess the very highest and 
lowest aptitude levels, scores of "1" are 
collapsed with "2" and "f)" with "4". The 
remaining scores of "2", "3". and "4" then 
indicate aptitude levels in the highest, middle, 
and lowest one-third of the population, 
respectively. 

GATB. The first nine aptitudes assessed by 
the MESA system are also assessed by the General 
Aptitude Test Battery (GATB; United States 
Department of Labor. 1970). which was developed 
by the United States Employment Service more 
than 40 years ago (Dvorack. 1947). Droege 
( 1983) and Pantaci . Di-0(^(:o. Ferral. and Hawk 
(1977) refer to the GATB as- the best validated 
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aptitude test battery ever developed. Twelve 
subtests are used to derive nine aptitude scores 
— G, V, N, S, P, Q, K, F, and M — the first 
nine WQP nptitude patterns. gaTB scores are 
reported as standard scores with a mean of 100 
and standard deviation of 20; for purposes of 
the present study, aptitude scores were 
transformed to the 2~tO'-4 scale used for MESA 
aptitude scores, where 2 - 109 or higher GATB 
score, 3 « 92-108 GATB score, and 4 ^ 75-91 GATH 
score, corresponding to the highest, middle, and 
lowest one-thirds of the general populatior , 
respectively. 

Results 

Construct Validity 

At a basis for assessment of construct 
validity, a nine by nine matrix was derived, 
providing Pearson product-moment correlation 
coefficients between scores on each of the nine 
aptitudes as Measured by each of the two 
instruments (NESA and GATB). The resulting 
matrix is presented in Table 1. 

The underlined matrix diagonal is comirised 
of the nine correlation coefficients between 
MESA and GATB scores on corresponding 
aptitudes. Validity coefficients ranged from - 
.08 (General Learning) to .44 (Verbal) (M » ,25, 
SD « .12). Only three aptitude scores were 
found to be significantly correlated; Verbal (r 
- .44, p < .01), spatial (r - .43, p < .01), and 
Form Perception (r = .31, p < .05). 

Criterion-Related Validity 

All participants were displaced worke-*s. 
In other words, all had been Juccessfully 
employed in the sense of sustained Job tenure, 
but had lost their Jobs through some 
circumstance beyond their control (e.g., company 
bankruptcy or cessation of operations; lay-offs 
necessitatec^ by reductions in company sales or 
production). Criterion related validity was 
assessed by determin.^ng whether aptitude scores 
would have predicted success in thoBv 
occupations in which : t < ripants had, in fact, 
been successful . 

Occupational Aptitude Pattern (OAP) 
structure norms (U.S, Department of habor. 1979) 
were consulted to identify OAPs corresponding to 
the last position held for each participant, and 
multiple cut-off criteria in terms of GATB 
aptitude scores were recorded for each. The 
corresponding OAPs could be clearly identified 
for the last positions iield by 12 participants. 
In each cnae, the multiple cut-off scores for 
that OAP were transformed to the same 2-4 scale 
used for MESA scores and the GATB scores for 
each partlripant. were also transformed to that 
.'}arHe ncale. 

The MESA aptitude scores were consistent 
with CAP multiple cut-off criteria, and thus 
were accurate in predicting succef^s. for 5 of 12 
participants (^2.1%), while the GATB aptitude 



scores were accurate in predicting success for 7 
of the 12 (58. No significant differences 
were found between the two proportions, chi 
square (i, N - 12) « 0.67. p > .05. and neither 
the MESA nor the GATB scores appeared to J^chieve 
an impressive degree of accuracy in predicting 
occupational success wUli this sample. 

Discussion 

The results of the present study failed to 
support the validity of the MESA aptitude scores 
as indicators of vocational potential. Six of 
the nine MESA aptitude scores failed to show 
significant correlations with corresponding GATB 
scores. Even the highest validity coefficient 
found (Verbal, r » .44) was lower than 
correlations between subtests which supposedly 
measured differing aptitudes (i.e., MESA Finger 
Dexterity with GATB Form Perception, r « .49; 
MESA Finger Dexterity with GATB Spatial, r = 
.46) . 

It should be noted that the Interpretation 
of these correlation coefficients should be 
somiiwhat guarded because of the relatively small 
number of participants (n « 29) and the 
restricted range of the scores (2-4) used for 
the correlation analysis. These two limitations 
tend to restrict variability among participants; 
hence, reaching statistical significance is less 
likely. The former limitation was due to the 
unavailability of individuals having completed 
both the MESA and the GATB. The latter was an 
Inhereni: roblem with the MESA and the 
restricted nature of the scoring scheme 
employed. 

Little evidence was found to support the 
MESA'S criterion-related validity as well. The 
MESA aptitude scores were consistent with OAP 
multiple cut-off criteria, and thus were 
accurate In predicting success, for 5 of 12 
participants, while the GATB aptitude scores 
were accurate in predicting success for 7 of the 
12. No significant differences were found 
between the two proportions and neither the MESA 
nor the GATB scores appeared to achieve an 
Impiessive degree of accuracy in predicting 
occupational success with this sample. 

The small number of participants employed 
in the criterion-related analysis (n - 12) 
resulted from the author's caution, using only 
those subjects whose last ocjupation could be 
clearly classified using the CAP structure 
norms. Again, the small number of participants 
qualifies the results somewhat. 

The MESA has been criticized by users for 
producing scores that tend to be lower than 
scores produced by tests intended to measure 
corresponding attributes. In responding to 
these criticisms, the developers have stated, 
Valpar feels that too much emphasis is 
placed on the differences between scores 
obtained on different tests which are 
intended to measure the same factor. At 
the same time tno much emphasis is Dlaced 
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on the correlation of these terjtii... 
validity f«ea»uro8 of Uvis sort hnvo aiwvivs 
had been 'cii'ciilar' in nature. <*nd, very 
often the 'circle' can be unproduntlvc" 
{Valpar International. 1964. pp. ^10-211). 
The developers cl the MESA systow have 
discounted the importance of correlations of 
MKSA scores with other inBtrumt^Jits dc Binned to 
assess corresponding: constructs, in favor of 
sole reliance on content validity and 
intercorrelations awon^ MESA scores to support 
construct validity, "'hey suggost that the MESA 
aysten is criterion^r.^fercnced rather than norm- 
referenced and, thus, correlations with other 
measures are unimportant or even irrelevant, 
Interestinirly. neither the MESA's construct nor 
criterion-related validity were supported by the 
present study. 

Whether or not aptUude weasureB designed 
to relate to the entire world of work can truly 
be criterion-related measure« would seew open to 
question; even Valpar International (1984) 
states that MESA is "both criterion-referenced 
and norm-referenced". However, a number of 
authorities have stressed the importance in 
going beyond content in assessing the validity 
of criterion-referenced tests (e,g.. Berk, 1984, 
Cronbach, 1971 j Hnmbleton, 1984; Iiinn, 1980; 
Mcssick. 1975). In his thorough review on 
methods to validate criterion-referenced scores, 
Hambleton (1984) specifically recommends 
investigating correlations between criterion- 
referenced test scores with other measures. 
Intuitively, an individual who scores higher 
than another individual on a criterion- 
referenced measure of some aptitude, shy vtf^rbal 
ability, that individual would also be expected 
to score higher on another norm-reference 
measure of the same construct, if that construct 
indeed measures verbal ability. 

In conclusion, it appears that with 
displaced workers, the MESA aptitude subtests 
may not measure the same constructs as the 
GATB. Therefore, their scores should not be 
regarded as equivalent. Further, little 
evidence was found to support the MESA's 
criterion-related valid^^:v when the criteria of 
interest are WQP aptitudtis required for success 
in selected occupations. Thus, vocational 
cvaluators who use assessment information from 
the MESA system in determining vocational 
potential, still have very little empirical 
support f:^r the relevance ol that information 
for determinations and decisions to bn made. 
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An Analysis of Private Sector Rehabilitation Case Managers » Opinlonr 
Regarding Work Hardening and Work Capacity Evaluation Programs 



Virgil R. May III, Rh. D. 



ABSTRACT 

Rehabilitation case managers provide an 
invaluable service to workers* compensation 
claims adjusters. Through efforts of 
rehabilitation case managers, claims adjusters 
are able to determine appropriate medical and 
rehabili^-fttion service delivery. This 
consulting influence over claims adjusters 
suggests that rehabilitation case managers have 
the potential to be major referral sources for 
work hardening programs. However, market trends 
suggest these rehabilitation professionals do 
not refer a significant number of iheir assigned 
clients to work hardening programs. This study 
assessed the opinions of private rehabilitation 
case Managers regarding work hardening programs, 
and attempted to provide some insight regarding 
their program referral trends. The results 
indicated that rehabilitation case managers 
consider themselves to be knowledgjable and 
supportive of work hardening programs. The 
inconsistency of their perceived support and 
actual referral trende is explored, and further 
research areas are suggested. 
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Private sector rehabilitation case managers 
have established themselves as invaluable 
resources to insurance adjusters monitoring 
workers' compensation disability claims. Case 
managers are assigned the responsibility of 
providing direction to the injured worker for 
attainment of industrial rehabilitation goals 
while keeping the cost containment interests of 
the insurance community in the forefront. In his 
studies on the roles and functions of private 
sector case managers, Matkin (1982; 1985a; 
1985b;) noted the primary role of case managers 
who listed membership in the National 
Association of Rehabilitation Professionals in 
the Private Sector (NARPS) to be that of 
planning and coordinating clif.nt services, This 
stands to reason since a primary revenue source 
for case managers is the workers' compensation 
berefit provider. This particular role category 
lif;ted sub-categories which are noted as 
fol lows: 

i* Client orientation and service planning, 

2. Resource identification and referral, 

3. Service coordinating. 

4. Gathering and synthesizing information. 

5. Guidance and counseling, 

6. Dissemination of information (p, 8). 
The sub-category function of identifying 

resources and referring clients to allied health 
service providers su^^nts that case mangers can 
play a significant role in the referral process 
for work hardening and work capacity evaluation 
programs. Work hardening and work capacity 
evaluation programs specialize in evaluating and 
treating injured workers for musculoskeletal 
deficits and pain behavior dysfun^^-^on (May, 
1985; May, 1986a; May, 1986b; May, 1987; May, 
1988a; May, 1988b; May, Stuart, «i Barnes, 1986), 
Increased competition among physicians in 
private practice and hospitals expanding into 
day rehabilitation programs has forced work 
hardening program administratorJi to design 
sophisticated Marketing program.: to attract 
reforrals (Hay, 1986a; 1986b), Private sector 
case managers are a primary market consideration 
due to their close ties with insurance claims 
adjusters who monitor industrial claims. 
However, the author has noted little direct 
support from insurance claims adjustars or 
rehabilitation case managers, and has relied 
almost exclusively on physicians to refer 
industrially injured workers for evaluation and 
treatment. 

The purpose of this study was to determine 
referral trends of private sector rehabilitation 
case mangers to work hardening and work capacity 
evaluation programs. Additionally, the qtudy 
was designed to explore the opinions of case 
managers regarding the efficacy of work 
hardening programs. Several research questions 
were targeted and include the following: 
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\, Ara caaci managers knowledgeable regarding 
the work hardening program concept and purpooe? 

2, Overalls do case maxmgers taupwort work 
hardening rogranis? 

3. Do c^^ie mflnttgoirs consider the i^ork 
hardening report when deteiirdnlng vocational 
objectives and case monageme.nt direction? 

I^ethod 

SftHP l^ geloctlon 

Rehabilitation caae managers residing in 
Virginia and providing services in the 
private-for-prof it sector were chosen to 
participate in the study. A list was compiled 
using the Yellow Pages phone directories of 
Northern Virginia, Richnond, and Tidewater 
regions. Phone calls were wade to companies and 
private proprietary rehabilitation specialists 
to obtain specific names of employees so that 
the instruments would be sent to specific 
recipients* 

Demographic statistics of the group revealed 
that over 50X did r.ot hold any form of licensure 
or certification, while 50X of that population 
held one certification, 34X held 2 
certifications, and 8X held three 
certifications. The typical case load size was 
between 11 and 20 clients, and most of the 
respondents worked either for a national 
corporation (30X) or were in private practice 
(30X). Insurance company subsidiaries held 
employment for 20% of the participants. 

jTTptn^aent DeveloDment 

The survey questionnaire was developed with 
the aaaifltance of two rehabilitation case 
managers currently practicing in Richmond, and a 
staff member of The Rehab Clinic of Richmond who 
previously supervised staff for a southeast 
private rehabilitation firm. The task force 
compiled two statement lists, and met to discuss 
the inclusion and deletion of questionnaire 
items. A final survey questionnaire was chosen 
after agreement was obtained on all statement 
items. (Available from the author upon request) 

nit^,^ fv^necting Procedures 

Before the queBtionnaires were mailed, all 
persons and their supervisors were contacted to 
obtain their permission as well as commitment to 
participate in the study. A total of 167 survey 
questionnaires were mailed. Each recipient was 
asked to rate his or her agreement level 
rogarding the 22 questionnaire statements and 
the demographic form. A 5-point Likert-type 
scale was used, which ranged from strongly agree 
(1) to strongly disagree (5). Each survey 
questionnaire was mailed with a cover letter 
explaining the purpose of the research, and with 
a self addressed stamped envelope for the 
individual to return the completed 
questionnaire. The 22 statement items the 
sample population responded to are presented in 
Figure L 



Fi^^ure 1 

Ouestionnalre Opinion Statement Items 



1. There is a need for work capacity 
evaluations 

2. I prefer an assessment clinic over one that 
treats . 

3. I have a clear understanding of work 
hardening 

4. There is a need for work hardening programs 

5. I refer often to work hardening programs 

6. Verbal instructions from the adjuster 
influences my case management direction 

7. I suggest specific facilities to physicians 

8. The physician decides which facility to use 

9. I suggest specific programs to adjusters 

10. Insurance adjusters support work hardening 

11. I would include work hardening as part of my 
practice 

12. I understand the report contents 

13. The report length is satisfactory 

14. The report turn-arouncl-time is satisfactory 

15. I prefer a shorter, 3-5 page report with 
summary information only 

16. The report is useful for determining 
vocational goals 

17. The report information is used to obtain 
guidelines for case management 

18. I favor exit conferences 

19. I favor open communication by the facility 
to all persons involved in the case 

20. I favor programs that allow ,:the counselor to 
provide the rehabilitation direction 

21. I favor programs that allow me direct access 
to the treatment and evaluation therapists 

22. Work hardening programs enhance case 
resolution 



Follow-Up Procedures 

After two weeks had elapsed from the 
initial mailing, follow-up phone calls were niade 
to case managers who had not responded r.o the 
survey in an attempt to encourage them to submit 
their questionnaires. A total of 78 (41%) 
questionnaires were returned and all were 
suitable for the data analysis. 

atatiaU.Gyc-AMJxiifi 

Simple descriptive stacistics (means, 
standard deviations, and maximura/rainimum 
coefficients) were used, and Pearson Product 
Moment Correlation coefficients were applied to 
determine any significant trends among the rated 
statements. The statistical analysis was 
accomplished by using the SYSTAT PC statistical 
analysis package which emulates SAS (Statistical 
Analysis Systems) procedures. A Compac III 
portable computer which contained a 20 megabyte 
hard drive, 640 Kbytes of RAM on the mother 
board, and a 12-MHz 80286 microprocessor was 
used to run the program. 

p< >flultB and DiBcm aign 
Results 

A total of 78 (41X) :.urvey forjns were 
returned oi which all 78 surveys were considered 
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acceptable for the analysis. The data resultt^ 
are reported In Table 1. 

Table 1 

Meaiis and Btandard Devlatlonn of Respondent 
Ratings to the 22 Survey Items (n-7e) 

Statement « Mean Standard Minimum Maxlrauro 
Deviation 



1 
2 
3 
4 
5 
6- 
7 
R 
9 
10 
11 
12 

13 
14 

15 
16 

17 
18 
19 
20 
21 
22 



1.85 

1.75 

2.00 

1.74 

2.55 

2.34 

2.09 

3.03 

1.97 

2.66 

2.29 

2.24 

2.55 
2.77 

2.36 

2.01 

1.91 
1.82 

1.74 

2.07 

1.79 

1.88 



0.773 
0.710 
0.684 
0.874 
1.052 
0.776 
0.846 
0.895 
0.726 
0.920 
0.762 
0.809 

0.769 
0.912 

0.857 

0.712 

0.648 
0.716 

0.763 

0.879 

0.745 

0.821 



1.00 
1.00 
1.00 
1.00 
1.00 
1.00 
1.00 
1.00 
1.00 
1.00 
1.00 
1.00 

1.00 
1.00 

1.00 

1.00 

1.00 
1.00 

1.00 

1.00 

1.00 

1.00 



4.00 
4.00 
4.00 
5,00 
5.00 
4.00 
5.00 
5.00 
5.00 
5.00 
4.00 
4.00 

5.00 
5.00' 

4.00 

4.00 

4.00 
4.00 

4.00 

4.00 

4.00 

4.00 



Inspection of the above data suggests that 
the respondents were mostly agreeable with the 
22 items. However, some subtle differences can 
be extrapolated upon clorer inspection. For 
example, the participants feel there is a need 
for work hardening prograna (Statement #1), and 
also feel they would prefer an assessment clinic 
over one which only treats (Statement #2)» 
Howover, it appears that the participants may 
not be so bold as to suggest to a physician a 
work hardening, program that the respective case 
manager prefers (Staterent jJS). Other 
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statements that scored a low agreement opinion 
included statements 13 (length of report Is 
satisfactory), U (report turn-around time is 
appropriate), 5 (counselor often refers clients} 
to work hardening), and 10 (the adjuster 
supports counselor recommendations for woik 
hardening. 

The Pearson Product-Moment Correlation 
corfflclent was used to determine any 
relationships or trends In the data. 
Specifically, It demonstrated correlations 
among several of the statements which provides a 
better overview of the sample population's 
attitudes. The confidence interval was 
established at .01, and with the small sample 
size of 78, a large correlation coefficient was 
necessary in order to achieve significance 
(Skinner, 1984). Given these constraints, a 
correlation coefficient of .36 was established 
as the criterion for significance. 

The statement item with the most significant 
correlations was statement item #1 - 
"There is a need for work capacity evaluation 
programs". Statement items which correlated 
significantly with with statement item #1 
included statements 4 - "There is a need for 
work hardening", 5 - "I refer often to work 
hardening programs", 8 - "The physician decides 
which facility to use, 9 - "I suggest specific 
programs to adjusters", 11 - "I would include 
work hardening as part of my practice", 16 - 
"The report is useful for determining vocational 
goals", 17 " "The report intormation is used to 
obtain guidelines for case management", 18 - "l 
favor exit conferences", and 22 - "Work 
hardening programs enhance case resolution". 
Case managers who rated statement item #5 - "I 
refer often to work hardening programs" as agree 
or strongly agree also rated statement items 9 « 
I suggest specific programs to adjusters", 11 - 
I would support work hardening as part of my 
practice", 16 - "The report is useful for 
determining vocational goals", and 17 - "The 
report information is used to obtain guidelines 
for case management" at similar levels. 

Case managers who rated statement item #2 - 
I prefer an assessment clinic over one that 
treats" as agree or strongly agree also rated 
the following items in similar fashion: 

a) #4 - "There is a neod for work hardening 
programs . 

b) #5 - "I refer often to work hardening 
programs". 

c) #7 - "I suggest specific facilities to 
physicians" . 

d) #17 ~ "The report information is used to 
obtain guidelines for case management". 

Statement item #3 - "I have a clear 
understanding of work hardening" showed 
significant correlations with statement items 
#17 - The report information is used to obtain 
guidelines for case management" and 20 - "I 
favor programs that allow the counselor to 
provide the rehabilitation direction". 

The statement item #7 - "I suggest specific 
facilities to physicians" which was rated as 
agreed to or strongly agreed to was 
significantly correlations with statement items 
\l - suggest specific programs to adjusters", 
15 - I prefer a shorter, 3-5 page report with 
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summary informatirr* only'*, 16 - *'The report is 
useful for determining vocational goals*', and 
18 - "I favor exit conferences" ♦ 

Case managers who agreed to or strongly 
agreed to-atatc^^nt itcr^ <*16 "The report I's 
useful for determining vocational goals" also 
marked statement items 117 - "The report 
information is used to obtain guidelines for 
case management" » 18 - "I favor exit 
conferences"^ and 21 "I favor programs that 
allow n e direct access to the treatment and 
evslustlon therapists** similarly. 

The correlations to the controversial 
statement itei # 6 - "Verbal instructions from 
the adjuster influences «y case Management 
direction" included stateuent itens #9 - "I 
suggest specific programs to adjusters", 16 - 
"The report is useful for determining vocational 
goals**, 18 - "I favor exit conferences", and 21 
- "I favor programs that allow me direct access 
to the treatment and evaluation therapists". 

Finally, counselors who agreed with 
statement Item #9 - "I suggest specific programs 
to adjusters" also produced similar ratings in 
statement items #10 - "Insurance adjusters 
support work hardening", 16 - "The report is 
useful for determining vocational goals", 18 - 
"I favor exit conferences, and 19 - "I favor 
open communication by the facility to 
all persona involved in the case". 

Discussion 

The data results are consistent with 
Matkin's (1982; 1985a; 1985b) findings of 
private sector rehabilitation case managers* 
roles and functions in industrial , 
rehabilitation. It is obvious that case managers, 
who responded to this survey consider planning 
and coordinating activities to be a major 
responsibility. This is confirmed by the high 
agree and strongly agree ratings on statement 
items 16 and 17 » Counselors use program summary 
reports when clients have completed work 
hardening to establish vocOational gbais and 
direction. They indicated that these reportL 
are utilized to plan and coordinate the clients 
rehabilitation plan by establishing vocational 
goals and direction. Thus, reports assist case 
managers who utilize work hardening programs to 
better infora ^he insurance adjuster regarding 
the rehabilitation potential of the claimant. 

It is interesting to note that case managers 
who see a need for work capacity evaluation 
programs also see a need for work hardening 
programs and refer regularly to work hardening 
programs. This is consistent with work 
hardening models established by May (1985; 
1988a; 1988b). The key to May's work hardening 
model is the integration of an evaluation 
component, whether It be a full work capacity 
evaluation utilizing the physical and 
occupational therapist team, or a comprehensive 
vocational evaluation. Matheson (1988) further 
cited May's work hardening model as somewhat 
unique in that it included a vocational 
evaluation component a'^ well as the standard 
treatment regime. Thus, case managers who refer 
to work hardening programs usually expect the 
standard '*ork capacity evaluation, and therefore 
associate the two entities as work hardening . 



Case inanagers who suggest t physicians where 
they would like to have the client receive work 
hardening, aerylces when the physician indicates 
work hardening Is necceasar^r also 8ugpest"th«it* 
preferences to .-'rijiisters . These case managers 
appear to know how to maximize their exposure to 
these programs. They prefer the shorter report 
format over the comprehensive "raw performance 
data" reporti use it to determine vocational 
goals, and prefer to have a team meeting (exit 
conference) at the end of the client's program. 

There were a significant number of case 
managers who agreed or strongly agreed that 
insurance adjusters influenced their case 
management strategies. This suggests possible 
case management biases towaril the insurance 
referral source, These case managers favor 
becoming involved in the work hardening program 
through direct access to ^he therapy team and 
participating in exit conierences. It is also 
noted that these case managers recommend 
specific program facilities to adjusters, 
Perhaps the programs they recommend are the ones 
which have tendencies to bias report sumraari'*<» 
in favor of the referral sources. Furthc : 
research is recommended to further qualify these 
assumptions. 

It should be noted that a significant agrc' 
or strongly agree rating was recorded for 
statement itens #1 - "There is a strong need for 
work capacity evaluations" and #4 - "There is a 
need of work hardening". However, statement 
item #5 - "I .refer ofter to work hardening 
programs" rftKistere^d' a low agree rating, 
suggesting that case managers may not readily 
refer to work hardening programs. The author's 
6 year experience with work hardening program 
referral resources indicate that physicians and 
attorneys are the main supporters of these 
programs. Insurance adjusters rarely maxe 
direct referral to these programs for fear of 
encroaching on the physician's territory. 
Similarly, case managers refer, but not without 
the encouragement of the physician and the 
support of the insurance adjuster. This may be 
because of several factors. First, case 
managers collect revenues based on actual 
billable time spent working a particular case. 
If the client is enrolled in a work hardening 
program instead of a placement or medical 
management program, the case manager/client 
exposure and billable time are greatly reduced. 
Secondly, there may be a competitive fear on the 
part of the case manager that such programs can 
determine dysfunctional issues they may have 
overlooked or not considered. Thus, there is 
the potential for the referral source to depend 
more on the work hardening team for direction 
rather than on the contracted case manager. 

Qualitative Nature o! the Study 

Attention should be given to the (iimlitatlve 
nature of this study. The purpoi^e was to 
ascertain the opinions of private sector 
rehabilitation professionals in Virginia 
regardi'.lg work hardening program utilization. 
Pata regarding rehabilitation professionals' 
opinions of work hardening programs are 
nonexistent in the literature. Therefore, there 
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was little to draw reference when asaeealng the 
scope of qualitative meaaures. 

A qualitative inquiry is a particularly 
dealrable research method to use for this tyye 
of study. HoT/ever, enhancement of quality can 
only be reassured with the cooperation of tho8<» 
who were surveyed. The response rate is 
somewhat low, and generalitation to the 

MoJl L'l''?fJ"~yf*^^''^'' not be- jt.«lTiaFle. 
More specifically, this study surveyed only case 
aanagers residing in Virginia. Generalizing to 
the main population of rehabilitation case 
■anagers in the private sector is undeniably 
unjustifiable. 

Finally, the use of Pearsons' Product Moment 
Correlation Coefficients may be potentially 
misleading at best. Skinner (1984) noted 
possible inflated percentage of variance ranges 
with small sarple sizes, suggesting a high rate 
of error when determining significance among 
coefficients. 

StiMflry and ConciiiRinn« 

The rehabilitation case managers who 
responded to this survey are knowledgeable and 
supportive of work hardening programs. Case 
managers utilizing work hardening programs 
become involved in the total process. They 
support the use of exit conferences, desire to 
have access to the therapy team, and understand 
•and use the reports in determining vocational 
■goals and rehabilitation direction. It was 
suggested, however, that case managers do not 

to f/n««o^°/v*''' r ^^^^ P^^^'^' This may be due 
to financial and competltilve concami. However, 
work hardening programs will continue to focus 
on their primary mission (i.e., to prepare the 
injured worker for work) and leave the case - 
management services to the private sector 
rehabilitation professionals. To offer such 
services would only jeopardize or eliminate a 
potentially significant support system. 

Work hardening programs* are emphaslzlnt 
marketing plan development as competition 
increases amonx the private physical and 
occupational therapy practitioners, physicians, 
and hospitals. Program administrators need to 
target rehabilitation case managers as potential 
referral sources because these professionals 
provide case management direction for the 
workers^ compensation claims adjuster. With 
rehabilitation case managers' support, the 
workers' compensation industry will openly 
support work hardening programs. 

Research is needed to further analyze the 
opi-ions of the private rehabilitation case 
man*.^erB regarding work hardening program 
utilization. A review of the literature 
indicated that there is a void of research 
addressing private sector case managers' 
utilization prefereines of work hardening 
programs. The data in this study requires 
further analyses regarding demographic factors 
which may predict work hardening referral 
patterns of rehabilitation case managers. 
Expansion of this survey to a national study is 
also encouraged so that work hardening programs 
can be better informaed as to how to meet the 
needs of the rehabilitation case manager. 
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A MJTJQUI OP THE «ICH.'TTJ-BU3CH VJ.C.G. VILIDATIOI IS STUDIED BT PSTCHOMmitfTTIOPiRTIIS 



Robect I. KIcheaer 
Segulo Services, Inc. 
CicerO; Illinois 



iisrRicr 

Tkls Is a ctltlqae of IB Investigation ioto the reliability 
and validity of tke Tocitloial Assessient aod CorrlculuR Golde, 
better knovR is tke TJ.C.G., vklck atteipts to fill a need to 
dla9io8e areas of fscas for vocatloial traUIng, Probleis of 
statistical letkodMofy, Itei coastrsctloi, sull SQibers, aid 
rater bias ire livestljated aid dlscsssed for fstvre liproveieat. 
rke actsal validity Is fosid to be iisupported by statistically 
slfiiricait data at tkls tlie. Possibly vltk lipioveients to 
develop reliability, validity caa be correctly tested. Itroeg 
scffestloRs are ude to sklft froi liplrlcal lodel to a CoRstroct 
ralldlty lodel for lore leaalig aid tkeory developieit. 



This paper is a critique of ? HeichettURuschlDda) 
Inveitlgatloi of tke validity of the the Mocatloaal lissessieit 
and CvrrlcylQi Gdlde" lri.C.6.), a vldely recoiieaded ratlag 
scale for ratlig lentally retarded clients' vork statos 
IRQ8ck,SchDts,Nltkaig,Stevart,)lar,l)l2). Ii analysis of the 
(elliblllty Investigation, vklch vas also done, raises soie 
qiestlois vklck are also euilned because validity Is. not 
deioistrable vltkoot reliability. 

Tke eip!rlcar livestlgatloi vas to deterilie Mf tke 
V.I.C.6. cosld differentiate betveei groips if lidlvldials vlth 
varloss levels of vork eiperleice...tkei tke lidlvldiaPs score oi 
tke listroieit shoild be related to a specified level of vork 
peifiziaice" ind "be isefil li tke speclflcatlii of listrnctlonal 
objectives" (Neickettl I R«sck,lM(a|. Ikei a vocatloially 
defective fsictlon Is Ideitlfledi it Is appareitly assoied to be 
lodlflable tkrosgh eivlroiieital CirrlcHla tkat are iit specified 
beyond "vozker skiild received tralilig on tkese Iteis." it is 
lot clear If "tralilig" Is Interpreted to liclide lon-dlrect 
literventiois for vocational dysfsictlons based opoi defective 
social behaviors aid/or poor self-coicepts*, etc. vkere direct 
literveitlois bave not sicceedod. Ii eiaiple of lon-dlrect 
Interveitlois to liprove a client's pkeioieioloflcal perceptloi 
of kls Sorld" cosld be psyckotkerapeitic contact, indsding 
faiily tberapy for eivlroiiental lodlflcatloo. 

BackoroiBd of tke test insttiiMt 

Neichettl ( lischlDKb) state tkat literatare areas 
selected for searck in tke past bave foaad not Identified 
"specific training needs." rke ?.Ji.C.6. vis derived froi eipioyer- 
recoiieided vork-related iteis Oiitkan; I Ragielec,!)?!) to 
ssppieieit tkls void by eipkaslxing "leasoreieit of actual skills 
reqilred for eiployient," an "ecological analysis" approach*. 
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The V.I.C.G. Iteis ate directly observable fmctioDS 
reqnirlif soie supervisor lodfeieat. Host T.I.C.G.ltei ratings ite 
not refined enos^b to prodice tie diagnostic iiforiition required 
(ot coipreheisive iiterventioi plainlaq for unsiccessful clients, 

The copyrighted T.t.C.G.|tnsch,Schiit:,llithisf,Stevart,iliar, 

i. Iha aylhara anlal l.a *a«plrlcal av^al* in a «aapanlan arllcia 
(Hanikal|lkftu«ch«IMik>i -...Naaaarck af iki« Min4 iltn^U • 
raiurft la iha fle»r*ua aclanllfie ragliian of lad 4avalop«anl and 
vatld«llan luggaaljd by plenaara In lh« 1im\4 «uch «a 
II.L.Thernrflk«(l«4«). Manaun'l aanhaala upon asplrlclaa will anhanca 
lh> Maid af vac«ll«n«l a«« I ««« ian. . . • (a«phail t ravlawaf*Nl. Na 
aanllAn in aarfa af fl. L . TNnr ndlha * a (I<i71,lt77) lalar ndvecacy af 
lha CrttibacliC 1«S8> Canilrufcl V«lldlly aadali *le««llaii wa tik, 
wllh raapaci la a paychalaalcti 4aal, nallhar •Uau wall daaa Ihla 
laal pradlCl job aw c cat«?» . . . bw I rt^hmr *NN«I aCeraa •« Ikla 
laal aaan or alinlfy?' *Mhal doaa lha acera lall wa ibaul lMa 
Indlvldualt Daaa II carraapand la to«a naAnlnffwl irall or 
canalryc^ th,<^ ^111 ^.ip yndaraland MaV . . . • (MTT,f.70). 
1. Tkla p«r|lciilArly AppUai la tdaOwalaly akillod cllanlv uhaa 
• ra aParallanol ly doflnad a« "Nar^Ully Aalardad* by iilala Bapla* 
af Nanlal Maallh wha/t lha cllont hk% f«llad la caa^arala In 
paycNaawlrlc |««lln| «nd lha paailbla rala af Iholr aoollanal 
UJlablllly |« iin«««ot«ad. 

J. Or. Urla Iranfonhriinnar, iha fawndor af Mwaiin |cota«y, 
«fia<lfloa <I47«) ihAl II IntUda pbonoaanal 1 c« | vtrlnfalaa. 
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19B2I Iteis are grouped into ten doialoi. Tht researched 
Instiuieot deals vlth only ( of these 10 doialns, ellilnatliig 
kadeilc Skills. Further, three of the researched doialns'* have 
different nvibers of Iteis than the copyrighted Instruient. lo 
dlscissloR Is presented of the Itei changes (roi the 1)12 version. 

Itei selectiea and standardlutlon ace critical to 
reliability aid validity stidles. Reliability Is affected by Itea 
coBslioctlon to enkaiice clarity aid objectivity for the best rater 
test-retest replication and for inter-rater agreeienl. Validity 
is also iaflienced by kov broadly the iteis saiple acrois tke 
relevant dlieisiooi and velgkt thei. In this study, tvo Doialns 
sbov evidence of fanlty constractlon vlth a biasing dilUu 
tilui. (1) The Independence Douin has a score range fron I to 
11. The overall lein for ill gronpn In IS.IS snggests a celllig, 
and the SOO J] conflrnn It; the S.D. Is otkervlae leaningless. 
(2) tke ConnnnlcatUn Donah has a score range fron I to 21. The 
DISIllID SUCCII8 9f0np achieved i Kuv 2IJ on re-test, SDM.SS. 
An SD< 4.SS vkere no variance exists Is an error; It last be 
8D«D by definition. 

Test-reteit Iten reliability precednren vere reported done, 
bnt 10 valnes are given; only tke Donain iten-cUster titali are 
given for each stidy gronp. Ill ttt test-retent coefficients 
(Donain Iten-chnters by each subject groap) vere kigh and 
positive eicept for Ittendance/endorance (DI8)IIID-8DCC138), 
vblch vas kigk bnt lUiUifi. (-.0)1 

Ipllt-kilf relUbllltles vere all significant^ bit the 
Ittendance/endnrance Donain vas snspicionsly lover (.511) than tke 
next lovest, and acconnted tor only half tke variance that the 
average coefficients of equivalence did on other Donalns. 

iRterrater rellibllty had sone potential conpllcatlonn: 

(1) Only 2 (job coaches) rated only ( clients on a noblle 
Janitorial crev. To generalise fron these snnll—and posniblj 
honogenou—sanplen to all "prospective nnern..lnclndlnQ vorknhop 
sopervlsorn, vorkikop tralnern,...and Job sipervlsor. in tke 
conpetltlve enpUynint netting' or a vide range of client types, 
reqniren popnlatloa cinparlnonn, vklch vere itot prenented. 

(2) The statistic nsed for Mnter-observer agreeMnt percentage' 
vas Dniqne bit probably Incorrect, lo references vere given. It 
is discissed lo tke statistical nethods section. 

SnhUct groins 

This stidy vas designed to inventlgite validity by conparing 
foir different groipn: Greip rsmTUID/fOII KTIflTT; Groap I- 
DISIILIO riltlD/IOII lOJUSTHIIT; Groap C-D!ailRD SUCCHSfOL; and 
Group D-IOIDIIHtlD SOCCUJm. The ages ranged fron II to 51 
vlth 'approj^liately equal* ninbers of sales ni fenales. Sone of 
the nentally retarded (Groups i,B,tCl dIspU/ed vocitlonally 
inportant "secondary handicapping conditions,* but their Inpact on 
validity vas not analyzed to control for potential bias. 

The groups vere differentiated as foUovs! the first three 
(Groups IJ,C) hid 'severe to noderate nental retirdatlon" (Ifls 
belov 5S|. The Group I^SIILTMID/IOIIX KTIIITT sobjects had not 
been exposed to conpetltlve enploynent. The last ) groups il,C,0) 
had all been "conpetltlvely enployed" in iiervlce occupations, 
focatlonal (allore vas defined as having "been fired*; success 
vas defined as •wrking... for periods longer than six nonths." 
Groop C-tiSmiO SUCCISSm vere noted as follov5: "Ml of these 
Individuals (Group C) had.., participated In a conpetltlve 
eiployieiit training progtai..' Group D-IOIDISmiD tmtmi 
vas selected to provide contrast vlth disabled enpUynent In 
service occupations; they did not exhibit or report any 
'disability' (no eiotlonal nor secondary physlcal/connonlcatlon 
problens) and vere rated as "average" In enployers' 'vork 



pefornance" expeciactgiik. 

Reliability vas studied on only the three client groups, 
osUg slightly different client nunbers so ssall disparities 
occurred In the group neans. Apparently nost clients vere used In 
both EOllablllty ad validity phases, tkongk one groop varied 2n. 

It Is presuned that basic experinental objectivity u% 
satisfied by randonly assigning clients to Group A vs. enploynent 
opportunity (B and C) to avoid any contanlnating selection bias. 
That this nay uL )iave been so, cool.* be Inferred fron the 
folloving points: (1) it vas never specifically stated in tke 
netkodology; (2) tke "najorlty" of Group B-DIsmiD niLIO/fORI 
aOJUSTHIIT vere re*asslgntd to "vork idjustnent" and not "vork 
activity", vhete tke "najorlty" of Groop a-SRItTIKD/IORI ICTIfITT 
found tkennelves; and (3) 'raters... nay kave Inflated their 
(Group 2-DIIIILIO rilLIO/fOIK AOJUSTNIIT) ratingn because of tke 
perception tkat these Individuals vere high functloning'dnphasis 
reviever'sit 

stitlitlcil cimit , , 

I caution regards tke use of paranetrlc procedures. Standard 
convention requires at least tke possibility of a theoretically 
nornal dlntrlbntlon before pariietric correhtlon and difference 
statistics can be usea. lovever, forking vlth selected sub-sets 
of tke nornal population, piiticularly extrene ones like the 
Intellectually sub-nornal vhere ve are dealing vlth "tailed 
dlstrltutlonn", ve can Lui thi^t It is idUIiillllUlUill^ 
lon-pariuetric utatlstlci nay be tke l>eut alternative. Ihere 
paranetrlc procedoren are still conuldered, statistics for 
skevness and kurtoiis nist be calculated. These results are not 
available. 

It In also unacceptable to ose paranetrlc statlstics—vhere 
jiutlfied— vltk uNll popnlatiou nunbers< Group C-DIimiD 
8UCCI8S, a critical one, had only 11 Ss for the test-retest 
reliability correlatlonu, apparently Pearson rho. Conventional 
rule of thuub suggests 1)30. 

there Heut d' tloni are considered appropriate, nodern 
statiutlcu (Fiank,!'. offer critical tables to deterulne 
•population site to a^old naking a Type 1 or Type 2 error in 
accepting or rejecting the null hypotheses. 

The questionable statistic used on Interraler agreeuent Is 
described as follovs: To deterulne the Uterrater agreeuent of a 
Donain, the perre t agreeuent on each iten vithin thai Donain is 
calculated, and t^en the "percentage of Inter-observer agreeuent 
(OS tke total Donain) vas deteruined by dividing the Imi score 
by tke higkcr score.' The question that arises can best be 
llUstrated by tke follovlig exauple: If all of Donain Ts Iten- 
agreeuent percentages ranged troi m to US, then lOt vould 
appear to be divided by U\ to give the ansver of "lit agreeuent." 
Hovever, since non« of the iteus achieved over U\ mttml 
it Is difficult to see hov any group descrlpter (lean^iedian, 
node, etc.) could Inflate to over IDt. 

^fiflltsi iellabilitv 

Though a lengthy itteupt Is uade In this KenchettURosch 
stQdy(l)l(a) to Interpret statistically randou results to support 
their hope for reliability", rigorous science of any orientation 
nist reject this effort on the basis of tke data offerred In this 
study. Kore care In the scale Iteus construction and the 
iitheuatlcs vould ellulnate randou error, and allov for a clearer 
te!^t of the Issue. This conclusion o( unptoven reliability 
should be ^enerallted to the copyrighted T.I.C.G. versUi, as no 
distinction betveen It and the researched version vas advanced. 
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1 lliltatlon 1(1 this Study l5 In the Inlerraker 'agreemit* 
relloblllty on tkt ?.*.C,o, jcale, rirst, yjlng the questionable 
Jtaimic, they eonclmlt they have establlihed 'lellablllty' 
00 the itnetilliitlon ttoi 2 job coickci iitlio ( ilillirlr 
MP oyed clients. Roievei In post ficto speculitloo concernlna i 
hUh tatli9 score Under Soiala.Gioup C), they dlicovei ii 
eipltlca! distrlbitloi ol scores that Is unacceptable; the authors 
then feel It 'nay be an artifact of .a»n blai, because uiy 
subjects In the high group vere rated 'y their trainers, vho have 
a vested Interest In fheli locc ■..'(levlevei's Italics) 
Finally, the author's sunnarlie, 'the data presented here 
sijgested that, li tens of literratei agieeient, the MS 
provides a highly reliable leaiure of the vocational and soclil 
skills...' 
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FICWI! 1. Group lean score distributions for each Doiain, Vilidlty 
study menchettllhsch.nna). Difference statistic used is the 
Tutey's Honestly Significant pKference Test, Uterisks indicate 
.05 level of significait differences; superscripts Indicate 
interacting group(s|, 

note; Unaslerlsked nuibers Indicate that thoigh these group leans 
JJXJUlkuUill.BOHlB. tht dlKerence Is randoi. 



The deviant (-.{)) test-rekest coefflcleok for the 
Utefldance/eodorin^ Doialo In the OIsmw-JI/CC«S 9tOBp Is 
brUfly noted In passing vlthout dlicgoslon, HovevM, U iilntiU 
stitlstlcilly 'cleiB* experliental dMigo, cooservatlve cooventloo 
;eq«lie9 ellilniHoii u( ii»y scale coiponests vllh nejatlve teit- 
j^teit coefflclealslCroBbacMJSO. Thu, In tie Interest of 
"ngorm scientific reglieo of test developient\ It Is not 
possible to jQstIfy tke Inclisioi of tie Uttendaace/endiraflce 
Doiali Iteis U this fori aid they ipst be lodlfled for aiy fatare 
conslderalloi. (rMs also strengtheas tke spllt-kalf statistics 
as this Doiali vas the qiestlonable eleieit there, probably for 
tke saie leasoi.) Such action eihances objectivity. 

gesnlta: yalidity 

mm 1 presents the distrlbotlon of group leans for each 
doaaln vlth the slgnlflcaat gioup Interactlois noted. 

By operational definition, validity cei not be diionstrated 
by iirellable Instuients. since tellablll y vas not deioistrated 
In the first phase of this stidy, the validity qoestloi Is not yet 
resolvable. Tbe reialnder of this critlqae allovs tke NenckettU 
Bnsch stQdy*s (l)Ua) Incorrect aisiiptlon tkat tke reliability 
Issse vas resolved favorably to coitlaoe the validity revlev. 

The raters Investigated vere 'prospective users of tke tkc 
Ucloding voikshop sipervlsors, vorkshop trainers, job coaches, 
and job sBpervlsors U the coipetl ;lve eiployient setting.' after 
specilatlig that -rater biases' led to iieip€cted resilts, tke 
stody does not accept that a serlois Invalidity has eitered the 
rater*scale-clieit application at soie vylierable polit. 

NenchettUllQsck(l)l(a| siuarlie their flidlifs exteislvely 
vfth an (ion*eiplrlcal| rationale based ipon findlig lipoitaice 
lo statistically iislgnlflcant lean dlffeteices; hovever, a 
*rlgorois scieitlfic test reglien* reqilres rejectlig 
statistically lislgilflcaat associations evei vlth liplrlclii. (If 
oae viskes to develop a systei of hypothetical constrocts, thei 
one Is leavlig hplrlclsi for Constrict ?alldlty lethodology, bat 
it lust be doie hUllildata gatherlig to lalotain "rigorois 
scientific' objectivity.) 

Their critics validity Issues can be eiplrlcally expressed: 
(II Do differences exist between tbe 4 gtoips? (}) Are they 
(systeiatleally?) related In aay vay (a) that 'the Individual's 
score on the Instriieit skoald be related to a specified level of 
vork perforaance'?, and (b| 'to be osefil In tke speclflcatlai 
of lastroctloial objectives for persons vlth haidlcaps'? (It 
coald follov that (a) ilgkt be troe, bgt (b) not isefol If, for 
Instance, the V.I.C.C. scores turned out to be liversely related 
to eiployablllty.) 

NenchettI i Posck (IM(a) conclide; 
(il mm 1 deioostrates all statistically significant and 
Insignificant differences that occurred. The Leaning Doiain vas 
tke only Doiain lo have fliitiUltklUjf tittUlmi different 
betveen ifijf of the groups. COHMKIT: The consistent difference 
vas betvten Oroop 1 and the others as a block. 
(2a| 'The pattern of the difference betveei group;, siggests that 
subjects vlth less restrictive vork placeients vko have successfil 
coipetltlve eiployieit experience M tfi. score higher on fUCG 
doialns than do sibjicts placed In lore restrictive, sheltered 
settings. The tvo sabject gtoips vlth siccessfal coipetltlve 
eiployient experiences (Groups C aid D) cAfliliUlUl iMl^ the 
highest or second highest average doiain scores, vkereas tke tvo 
subject groips vko vere vorklog In sheltered settings (Groups I 
and 8) CPflMaUfltlj. ^mti Invest on fACG doialns. The tvo 
exceptions. .Independence aid learning doialnsMeipliasis reviever). 
(Jb) This H not specifically discassed, but the lipllcatlon Is 
that vherever there Is a score Increase vlth job success, that 
7.LC.C. doiain can function to diagnose 'Instioctlonal 
objectives.' 
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COHHtIt (]i) ; Reftience to tliM 1 deionstiates thit 'tht 

{)ittern..si)9e8t8 teid tc-.M^htst o[ second highest ' 

obtcHM tht statlitleilly iMMdviit iicL thtt fOincmiTi/ 
mimOP G[oqp > »I8 tht ttll9t«»P KCUlflMllY dIKeieat dad 
lovesti f[oi the othet thiee (Is ) doiilis), fios tvo lost 
sitccesslil (In 1 diiiln), aid Un G[0ip C only (la 1 doiiint). 
Only one (1) solltiiy ilqtKlcint dlffeiiice existed out of 11 
possible Inteiictlois betmt C[oipi I, C, ttA 0— uuUjuM 
h« h» ektMt ii tht ..'I Itv el at nrihibllHy. COHHMT 
|]|): fith 10 ititlitlcil iiiOilcU.i betviei UCO doiilns aid the 
level ot vocitloul {iRctloiInt, do iciedlil pitfiml' >> PO"ll>le. 
Ill this leieitch lidlcatei Is, that In Its cviieit (on, that the 
f.t.C.G. dttfeientiatei betv^en lOlI hCTITlTT/IOIUIlOP 9ioip ind 
liotpi eiposed to coipetltlve vocational placeieit (both (alUd 
and stcceiitil). 

is an eiaiple o( a Conitiict Validity lethod <ifplled to this 
Investlfatlei, ve ceild develop the follovLig fOEial [atlonale: 

RTPOTIIilS 1: If the T.I.C.O. hae the potential to dlijeose 
vocational differences, theie vlll be ilfsKlcanl scoie 
diffeiences betviei DItmiD-rilllD (Gionp II ind DlillllD-SVCCiSS 
(G[oip Cj. 

momill la: If the DIUIllD-SttCCIIS groi; scoits iie lai^ei, 
the T.k.C.O. ceild b« need to diagnose reaedlal Interventions. 

Tilt or lii Coipire Group I and Gronp C leans on each of the 1 
rellible* doialns fsr stitlstlcilly significant differences. 

HMITIOP I. TIIT dee rinil II: 

iHiber ef Doialis vlth etgilflcait I v. C differences: 0 
liibor ef Douiss vlth no slgnlflcint differences: 1 

COianiOl I: llice iftsliilfUiit differeieer txlst In the scores 
bttvMi Dtlllin-rilllO Hi DkimiMOCCIII groip loans, the 
T.I.C.O. doialis ire iit issoclitid vUk vicstioial fenctlonlig is 
they ire cerreitly eoistricted. 

M 

niT or li.: let tried (dependent ipon l> snccess) 

ptittfit. gmiiiT 

H^T ^"1 Of mil rtt cuilTl ? 

If there »ii " selection bias. It could itai: »hatever 
kappiied to dlente ifter they left' sheltered eiployient, vhethot 
they Mcceeded ti ciipotUive eiployieit or not, thelt U.C.S. 
ritlige »oeH iBcrease except for the Uiriiig OomIi. that the 
M.C.O. really leais is lot resolved is previously lentloned. 

mU HTTII!" """MTliTM thf ll'"P i-hhiiilid 
riiLiD f roi til flriiit C-P'""" """" ^ '»•• . • 
repord thil ill » if the Iroip C cliints Kere In i 'coipe itive 
eiployieit training progrii' »hlch appirintly «s niavillable to 
the GroBp I clients. The M.C.O. did not ehov any differences 
betvcen the tvo groips even vlth this poeslbly critlcel trtatient 
difference. 

Hfti rin TH T.l.C.ff. u vtLlDtTlD ? If the obvlois probleis 
vlth the Itei coutrictloi, stitdtlcjl selectloi, ar.d riter 
lelliblllty/blas cai be coirected, the esch-soughl ""'(ll'tlf 
iiy be achieved, and It coild ttrn out to be valid. Tlthoot 
reiliblllty, validity can lot be iccorately deterilneJ, If » 
deiied-Bp T.i.C.G. shoild prove Invalid, then nnch tuit conplei 
theorlring about the natire and breadth of vocational stills 
trilling functions In relation to vocitloail success. Ptrhipi i 
reconsldetillon of seie very proilsing early aptitude developient 
and functioning research voald be appropriate (Taylor, UH) or 
lore consideration should be given to eiotlowl Instability, etc, 



Hit t8 IRQHC IIT8 ^ PlCyiiHHII """T Til RRSULT5 ? leSuUs 

specolatloas by thenselves are vlolitlois of all jcleillfic 
objectivity, ind leid le bUrred thlitlng, disregard of 
statistical significance. Ihen testable constructs are defined 
orginlied Into a theoretical stractire btllJU. data gathering, then 
a Coistnct filldlty nodel Is geierated. Construct liUdlty Is a 
nore poverfsl research tool than liplrlclsi, as It illovs lore 
coiplex theories to be slovly generated, tested, aid corrected In 
a scientifically objective laiier. It nst be good: 
Henchelllllosch(UI(a,b)'s statistical authority, »• ;;h«"J | 
heartily approves lt(l)71,lJlll ilong vlth l.J.Cronbach(U55,l)n) 
even If they vere inavare of It. Danpler(l)H) details tht 
developient of the Hypothetlco-Dedictlve (Construct Talldlty) 
lethod In physics. 
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VOCATfONAl, PATTliKNS ANb WUKK CONCKPTS OK UI-COVKRTNC ALCOHOLICS 



ANITA A. KII)1,KH00VKR 



Abstract 

More than half of the problem drinkers In the 
United States are employed. Their behavior costa 
billions of dollars due to resulting problems of 
absenteeism, accidents, loss of productivity, and 
effects on supervisors, coworkers, subordinates, 
family, and society. The alcoholic holds onto 
the job desperately, as it is often the last 
rerource enabling him or her to continue 
drinking. Alth ugh some of the problems of the 
alcoholic worker have been described, information 
ts not rondily nvallable on the vncatlono.l 
paLierns oT rocovcrln^; alcoholics. Little* 
researcli hot been conducted on work concepts held 
by recovering al.-oholics to determine how these 
may affect vocational patterns such p.a product- 
ivity and stability, absenteeism and tardiness, 
and accidents, Through the use o.'' Personal 
interviews, this study describes the vocational 
patterns and work concepts of six recovering 
alcoholics. 



2?A 



Alcoholism has been cited as our nation's 
third largest health problem (Kaplan, Freedman, 
& Sadock, 1980), with the majority of alcoholics 
as active members of the workforce. In 1981 it 
was estimated that there were 10,2 mill-'.on problem 
drinkers in the United States an^ that naif of 
these were employed (Vicary & Resnick, 1982). In 
1985, the number ()f employed alcoholics was 
reported to be closer to 65 to 70 percent, with 
an even higher proportion in some countries 
(Shahandeh, 1985). 

Vicary and Resnick (1982) reported that the 
"billion dollar hangover" of the 1950's has. In 
the 80\s, been esllniated to cost industry 42.7!) 
billion dollars annually. This estimate included 
wasted time and materials, absenteeism, accidents, 
poor decision-making, lost sales, and low morale 
(Vicary & Resnick, 1982). According to Wright 
(1984), the alcoholic employee is absent sixteen 
times more often than the average employee. 
Absenteeism resulting from alcohol and drug abuse 
costs ten to twenty million dollars annually 
(Shahandeh, 1985). Accidents and sickness bene- 
fits are paid to the alcoholic worker three times 
more often than the nonalcoholic worker (Vicary 
& Resnick, 1982). The energy divested In hiding 
alcoholism reduces productivity. Loss of effec- 
tiveness may manifest itself in either physically 
or mentally absent employees (Fennel, Rodin, & 
Kantor, 1981). 

The United States is not the only country 
whose industry is heavily affected by the cost of 
alcohol abuse. Alcohol abuse costs Australian 
industry approximately 600 million American dol- 
lars annually, Canada's annual losses are about 
$7,600 million, and Brita^a suffers a loss of 
about $ .,500 million annually (Shahandeh, 1985), 
IC Metall, Germany's largest union, believes 
alcohol contributes to one third of that country's 
industrial accidents (Shahandeh, 1985). The 
United Kingdom reports that seventy to eighty-five 
days per year are lost at work by alcoholic em- 
ployees, in addition to tardiness (Hore, 1977), 
A study in l-'rancc indicated that work accidents 
among alcoholic^ are two to three times greater 
than among other employees (Goddard, 1981). 

However, t^^e true cost of alcohol abuse in 
the v/orkplace f r exceeds the coat of absenteeism, 
medical benefit j, and accidents because it affects 
not only the cihployce, supervisors, coworkers, 
and subordinates (Fennel et al., 1981), but also 
thc! family and society at large (Shahandeh, 1985). 
To the alcoholic, work is often the only remaining 
fnalm after losing family, friends, and faith. 
Talbott (1984) describes the "target syndrome" in 
which the substance abuser peels away layers of 
activities and people— f list the church, then the 
community, then friends, hobbies, and peers, then 
Iho fltstnnt fanij.ly, nnd ^n.•^^]y th:? nuclo/u' fam- 
ily, Tlie loss, or tiiroat: ot Loss, of .i j(,h c^in 
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bocome the breaking point in the tilcoiio U c ' s 
denial (Ronan ^ Reicliman, H86). F.vorythinA dsn 
hah* been lost or damaj^ed. ^ork loses Its mean- 
ing, becoming only a mecho^J to continue buying 
alcohol — just a paycheck instead of a source oT 
self-respect and individual worth. The job is 
often the bottom line which, when threatened, 
may c-.use the alcoholic to seek help (Wright, 
lw84). 

Once the alcoholic seeks help, vocational 
rehabilitation is extremely important to the 
overall treatment process, Several sources have 
described the therapeutic effects of work. Black, 
Kase, and Benney (1981) reported that work was 
therapeutic by providing a structure where rehab- 
ilitation can take place. Ronan and Reichman 
(1986) stated that work serves as a process in 
which the recovering alcoholic can regain self- 
esteem and dignity. In a study by Dysz.lewski 
and Dyszlewski (1981) full-time vocational 
activities were shown to be positively related to 
maintenance of sobriety by low socioeconomic 
status a]coholic5. Braunstein, Powell, McClowan, 
and Thoreson (1983) reported that employment 
status was a significant variable related to 
positive outcome on mood and neuropsychological 
functioning of alcoholics. Kahn and Fua (1985) 
demonstrated an association between alcoholism 
counselor training, sobriety, and effective voca- 
tional functioning. Patients trained as coun- 
selors for other alcoholics showed increases in 
self-esteem and a sense of adequacy (Kahn 6 Kua, 
1985). 

Therefore, when an employer is willing to 
hire a recovering alcoholic, he or she aids in 
the rehabilitation process. Employer discrimina- 
tion has been cited as the main barrier to 
obtaining employment by recovering alcoholics 
(Ronan & Reichman, 1986). Employers see alcoho- 
lics as poor risks unworthy of an investment in 
training or a job. Although alcoholics have been 
protected against discrimination since 1973 under 
Section 504 of the Rehabilitation Act, this has 
neither been enforced nor widely acknowledged and 
alcoholics continue to have a stigma of possess- 
ing neither the ability nor desire to find or 
keep employment (Forcier, 1982). The recovering 
alcoholic is enmeshed In a Catch-22 situation 
vhere to be honest about a drinking prob.om may 
result in discrimination, while to be secretive 
is perpetuating a stigma and viol :es the honest 
behavior acvocated by therapy (Forcier, 1982). 

This study of recovering Ocoliolics was con- 
ducted in order to investigate c. ^ects of work 
which hav(^ changed since the cessation of 
drinking. This was accomplished by comparing 
vocational patterns and work concei ts pre- and 
post-treatment from self-reports of recovering 
alcoholics using qualitative methods. 

Methods and Procedures^ 



Due to the confidential nnturc of the topic 
under investigation, sampling procedures wure 
nonrandom and subjects asked to participate 
because the author knew thcni tn be recovering, 
alcoholics. Six recovering* alcoholics partici- 
pated In the study. P.-irt: i c i pnnt .s wero solcctfcl 
|)cc;ni'i(' ihi'V h.id iii.i i nl .r i ikmI sohriciv fOr .i mini 
imtm (»l OIK' ViMTi wi'ir ciupjoyt'd or en rn ! I (.-d in 



school at Liu* time of tht* interview, liad an 
c^mpioymont liistory prior to trontinent , and ii.'ul a 
significant uthcr who would be wiJ.ling to con- 
tribute Information. 

Throe sources of data were obtained from 
each subject: a taped personal interview, a 
questionnaire completed by the subject, and a 
quest ionnnaire corr leted by a significant other 
sucli as a family member, employer, spouse, or 
friend who knew the subject both prior to and 
after treatment. Information from each data 
source was grouped into three categories: back- 
ground history, pre-t reatment work history, and 
post-treatment work history. 

Data Analysis 

In the data analysis, a list of coding cate- 
gories was developed. Coding categories are 
regul arit ies , pat terns , and topics in the data 
which are represented by descriptive words or 
phrases (Bogdan & Biklen, 1982). Each coding 
category was assigned a number. Coding catego- 
ries used in the final analysis were: 



1. 


Age 


2. 


Education 


3. 


hengtli of drinking 


A. 


Recovery l.engtli 


5. 


Treatment programs 


6. 


I'^'oltoW'up activities 


7. 


Drinking patterns 


8, 


Absenteeism/ tardiness 


9. 


InJ ur ies 


10. 


Hangovers/drinking on-the-job 


IK 


Self-percept ion 


12. 


Employer relationships 


13. 


Coworker relationships 


14. 


Enabling 


15. 


Attitude towards work 


16. 


Quality of work 


17. 


Future goals 


18. 


Job histories 


19. 


Reprimands, suspensions, firings 



Coding category numbers were assl';ned to each 
unit of data (i.e., sentence, paragraph, or group 
of paragraphs) that fall under tliat particular 
topic, and the data units separated according to 
coding category. Data was then represented by 
direct quotation and description of the subjects* 
responses. The questionnaires were used to 
crosr-.-chcck the accuracy of tlie intcrviciws — the 
primary data source — as suggested by c;oet/i and 
LeCompte (1984). 

Kesijlts 

B a c kg r o u n d History 

The subjects, four male and two female, ranged in 
age from twenty-seven to fifty-five. Educ;?*-ion 
levels ranged from tf-ntfi grade to the doctorate 
level. Length of alcohol abu.'u? averaged 14.8 
years, ranging, from tliree to twenty-eight years. 
None of the subjects reported receiving help from 
an Employee Assistance IVogram. All the subjects 
had participated in at least one residential 
alcoliol t rent men t program; most subjects had been 
i n I ret I irn'H I I Wf > nr I h ice I j inc. . 

Thi' j.t.iiul.ird IriD'lh of sl.iv in ti(MUn»M!l wa.s 
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twenty-eight days. Treatment prlniarily featured 
an intensive study of the twelve steps of 
Alcoholics Anonymous, a spiritual program based 
on honesty, turning one's life over to a 
"Higher Power", and workini; with other alcoho- 
lics. All six participants relapsed. Subjects 
reported their last treatment center offered 
more intensive emotional work, such as copinR 
skills and how to deal with feelings, in addition 
to AA. Vocational rehabilitation services were 
offered in some but not all of the treatment 
centers attended; however, none of the subjects 
received these services at that time. 

At the time of the interviews, all of the 
subjects attended Alcoholics Anonymous. In 
addition to AA, other follow-up activities 
included: Narcotics Anonymous, Al-Anon, Adult 
Children of Alcoholics (ACOA) , psychotherapy, 
drug and alcohol urine screens, and Aftercare. 
Aftercare, a follow-up program offered by most 
treatment facilities that clients are urged to 
attend upon discharge in order to aid in the 
maintenance of sobriety, had been completed by 
only two subjects. Ineffectiveness and lack of 
structure were given as reasons for not com- 
pleting Aftercare. 

The following occupations were represented 
by the -subjects: administrative secretary, 
automobile-body repairer, industrial painter, 
student, and substance abuse counselor. The 
sixth subject was employed as a laboratory 
technician, a bartender, and a professor at a 
junior college concurrently. Job stability was 
more evident after treatment, as most of the 
subjects had been employed at the same job since 
discharge from treatment. Prior to treatment 
subjeo hanged jobs more frequently, job tenure 
was she .er, and, in general, salaries were 
lower; however, two subjects reported a decrease 
in salary after treatment. 

V ocatiOTial Patterns 

Many aspects of work were analysed and shown 
to change considerably after discharge from 
treatment. Attenclance at work increased. Prior 
to treatment, subjects were absent from work an 
average of 4.4 days a month; after treatment 
subjects reported they were rarely or never 
absent from work. Injury rates were hig^er prior 
to treatment; however, only one injury w s attri- 
buted to drinking. All of the subjects reported 
attending work with hangovers, and if they did 
not actually drink on-the-job, attended work 
while under the influence. 

Employer relationships improved in quality 
after treatment. All subjects rated relation- 
ships wiuh their employers as being below average 
prior to treatment, while after treatment, 
emplryer relationships were rited as average to 
above average. Incidents such as reprimands, 
suspensions, and firings were less frequent and 
more easily isolated after treatment, with defi- 
nite precipitators. Kor example, one subjert was 
technically "fired" when his place of employment 
was taken over by a new management team, in 
order to be rehired under the new managemont. 
Coworker relationships, although satisfactory 
prior to trontnicnt, novcrthel oss improved aftor 
(I t .'ich.-i r)',('. I I w.is coiuiuon lOr cowurkt't v; to 
"enable" the subjects. Enabling is a tendency to. 



consciously or unconsciously, facilitate drinking 
for the alcoholic. Reported methods of enabling 
included; acting sympathetic, camouflaging by 
covering up absences or failing to alert employ- 
ers, not knowing how to "handle." the situation, 
to such overt behavior as doctors writing pre- 
scriptions for one subject who was a registered 
nut se. 

A recurring theme throughout the interviews 
was that of the practicing alcoholic as an excep- 
tional worker. Subjects described themselves as 

perfectionists", "overachievers" , outstanding, 
over-responsible, and hard workers even while 
they were drinking. Although the subjects con- 
sidered themselves and believed others considered 
them to be excellent workers prior to treatment, 
they nevertheless reported the quality of their 
work suffered and improved once they became 
sober. Ail subjects rated their work quality as 
below average prior to treatment and above aver- 
age after treatment, which was consistent with 
ratings by their significant others. 

Work Concepts 

Subjects consistently found work more 
rewarding after troatmc^nt. Prior to treatment, 
work was seen as a means to a paycheck to sup-' 
port the alcoholic lifestyle; it was viewed as an 

income , a cover" if one had to go to court, a 
way to maintain the "habit". Subjects saw them- 
selves as "lazy", self-pitying, and having a fear 
of failure. 

After treatment, work took on a new meaning. 
Work was described as a challenge, a source of 
enjoyment and pride, providing hopefulness and 
a purpose to life. One subject expressed grati- 
tude for having a job and described it as a 

saving grace". Self-perceptions changed as 
subjects saw themselves as more assertive, 
patient, motivated, dependable, and responsible, 
in addition to having an increased sense of self- 
esteem, capability, self-worth, and self- 
sufficiency. Job satisfaction and value for the 
work one did was also considered important. 

Having go.ils playcul an iinportont part In the 
recovery process for the subjects, generating 
hope where there was none Letore. When questioned 
about their future goals prior to treatment, 
subjects tended to respond in a pessimistic, 
negative manner. When asked about their current 
goals, subjects responded optimistically, indi- 
cating a willingness to work toward those goals 
by taking the necessary steps to accomplish what 
they desired. 

Conc lusi ons 

To many practicing alcoholics, work mean^ 
only a paycheck— a way to buy more alcohol. Work 
frequently is all that remains after the alcoholic 
has peeled away layers of people and activities 
like the skins of an onion, as describpd by 
TaJbott's (198A) "target syndrome". K dinrs in 
this study are consistent with the view that work 
Is important to alcoholics because it onnhlos them 
to continue drinking. When work is tlireafr ed , 
many problem drinkers seek help at an alcohol 
trontmont ct^ntfr. 

'Hms :,Uh)y i,.vc..a|(Ml |.h,u niai n L ,.n.inc- c ol s„I,-. 
riety was fncilltatod when subjects attended 
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treatment centers that offert'd personal r.ruwLh 
and development skills training in addition to 
the study of Alcoholics Anonymous, and that AA 
alone was less effective in maintaining sobriety. 
Follow-up activities such as support group par- 
ticipation and psychotherapy were more effective 
in maintaining sobriety than Aftercare, a program 
offered by many treatment facilities. Therefore, 
a model alcohol rehabilitation treatment program 
might emphasize personal growth and development 
skills training, support group attendance, and 
psychotherapy* 

As can be expected, most vocational patterns 
and work concepts improved after treatment dis- 
charge. Job stability, as characterized by less 
frequent job changes, longer Job tenure, and 
higher salaries, increased. Work attendance 
increased while on-the-job injuries decreased. 
Supervisor and coworker relationships improved 
in quality. Work quality improved. It is inter- 
esting to note that all the participants in this 
study considered themselves to be exceptional 
workers prior to treatment. This was attributed 
to overcompensation for shortcomings and a need 
to be "perfect". 

It is possible that improved vocational pat- 
terns can be attributed to changing work con- 
cepts. After treatment, subjects reported work 
was more rewarding, presented a challenge, and 
provided a source of enjoyirent, pride, hopeful- 
ness, and a purpose to life. Job satisfaction 
and value for one's work was considered impor- 
tant. As self-perceptions changed, subjects 
regarded themselves as more assertive, patient, 
motivated, dependable, and responsible. Feelings 
of self-osteem. capability, and self-sufficiency 
increased. Subjects responded in a positive, 
optimistic manner when questioned about future 

goala. ^ - 

This study broadly examined vocational pat- 
terns and work concepts of recovering alcoholics. 
Further research is needed to e camine any one or 
a combination of these factors with a larger 
Knmplc. 
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rvices 
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SoutheiTi Illinois University at Carbondalc 



Abstract 



This study assessed client ("consumer") satisfaction with 
vocational evaUuilion services as a function of eight 
demographic variables. The resulis of 154 clients at a 
comprehensive, rural rehabilitation facility indicated that they 
were generally satisfied with vocational evaluation services 
and only one demographic variable (i.e., the client's 
financial arrangements) significantly influenced satisfaction 
ratings. Expressed satisfaction was also found to decrease 
as a function of the length of time spent in the vocational 
evaluation program. 



A proliferation of information concerning program 
accountability and consumer satisfaction can be found within 
the rehabilitation literature of the early I970's. Consumer 
involvement and program evaluation were two prominent 
themes stressed in the Rehabilitation Act of 1973 (Rubin & 
Roessler, 1987). The rise in consumerism and the demand 
for accountability pressured vocational evaluation, as well as 
other rehabilitation programs, to address the issue of 
consumer (also known as client and/or service recipient) 
satisfaction with provided services. The combination of 
these two themes resulted in the demand to evaluate 
increased consumer involvement and indicated that 
considerably more attention will need to be given to 
consumer satisfaction with such things as type of services 
received, the length of programs, and the process of 
vocational rehabilitation. 

The demand for legislation requiring the evaluation 
of programs and services offered by rehabilitation facilities is 
not a new one. It has been only recently, however, that 
service recipients have joined togethcar to voice their 
collective opinions and perceived needs, and to demand 
accountability for services received. Demands for more 
comprehensive services, including more efficient and timely 
delivery of services, have been vocalized by persons 'wth 
disabilities since the late l970's (McFarlane & Frost, 1981). 
"According to one comprehensive survey, tiirec-tenths of 
successful rehabilitants and nearlv half of non-rehabilitants 
were dissatisfied with their rehabilitation plans or claimed 
that none had been prepared" (Levitan & Taggart, 1982, p. 
99). Habcr C1984)reportedthat the Rehabilitation Act of 
1973 "... institutionalized a sense of entitlement for disabled 
persons among the general population and in the federal 
government and has been a stimulant towards the 
organization of disability advocacy groups" (p. 27). Finally, 
Rubin and Roessler (1987) compared the rise in consumer 
awareness among persons with disabilities to that of various 
other minorities whose segregation from society was based 
on such things as ethnic origin, and religious or sexual 
preference. 

Traditionallv, a paternalistic attitude provided a 
rationale for rehabilitation professionals to exert control over 
the lives of their consumers by limiting their access to 
educational, financial, vocational, and emotional assistance 
(DcJong, 1979). McFarlane and Frost (1981) concured with 
DcJong s (1979) observations. They further elaborated that 
although the rise in consumerism by persons with disabilities 
appeared to be a positive step towards independence, "it is 
one that has not attained a balance between the delivery of 
services and consumer expectations and demands" 
(McFarlane & Frost, 1981,p. 21). Consumers remain 
encouraged to become involved in their service eligibility 
determination and Individual Written Rehabilitation Plan 
(IWRP) development. The demand for consumer 
involvement also resulted in the appointments of 
rehabilitation service consumers to governing boards of 
facilities and agencies at the local, state and federal levels. 

l^rogram evaluation methods are used to examine 
such Items as the number of consumei-s served, the ovenill 
effectiveness of service delivery programs, and the degree of 
consumer satisfaction with provided services (Rubin & 
Rocsslcr, 1987). Traditionally quantitative measures have 
been used to document program effectiveness. Some 
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examples of quaiUiUUivc measures include (a) the number of 
consumers served, (b) the number of successful closures, 
and (c) the number of persons who achieve a criterion 
level on a si)eciric test. Patterson and Leach (1987) also 
included fiscal considerations (e.g., number of dollars 
gained and amount of profit realized) in program evaluation 
dam. 

A recent shift in program accountability has been 
nol.d and program evaluation systems are now beginning to 
supplement the traditional quantitative program evaluation 
measures with items cxploi ing consumer perceptions 
concerning the efficiency and effectiver/:ss of rehabilitation 
programs (Cook, 1977), These non-traditional program 
evaluation measures seek to determine the success of 
rehabilitation programs. Patterson and Leach (1987) 
predicts, however, that "while quantitative measures will 
continue to remain the central thrust of rehabilitation program 
evaluation, the feedback provided by rehabilitation 
consumers is valuable and should not be relegated" (p. 42). 
In other words, the rise in consumerism among persons with 
disabilities as well as their family members t^id advocates, 
has resulted in a demand for accountability that ultimately 
pressured rehabilitation programs to not only address the 
level of consumer satisfaction with provided services, but 
also the level of consumer satisfaction with the duration of 
services. 

Although consumer satisfaction^ with vocational 
evaluation, as well as other rehabilitaf'on services, is not a 
new concept, the topic has been n* ected only recently 
within the rehabilitation literature '.merous ai'ticles 
concerning consumer satisfaction were published during the 
period which coincided with the development of 
Rehabilitation Act of 1973; however, since the passage of 
the Rehabilitation Act of 1973, only a few papers exploring 
consumer satisfaction issues can be found. This 
undersupply of consumer satisfaction literature has lasted 
from the middle 1970*s until the middle I980*s. 

Two major reasons have been proposed for the lack 
of studies concerning consumer satisfaction (Patterson & 
Leach, 1987). The first reason addressed the difficulty of 
predicting consumer satisfaction through the criteria of 
treatment outcome (Pattei-son & Leach, 1987). Cook (1977) 
cited a study which revealed that the level of consumer 
satisfaction was directly related to the extent of consumer 
agreement with received services. In other words, whe.. 
consumers disagreed with recommendations for treatment, 
they were more likely to express dissatisfaction with 
received services. "Client satisfaction with rehabilitation 
studies have found that clients in the rehabilitation process or 
closed rehabilitated were generally satisfied with the 
program" (Cook, 1977, p. 112). 

The second reason concerned consumers' perceived 
ability to make educated estimates of the quality of services 
received. Consumers of rehabilitation services can certainly 
tell whether they wer. treated courteously, compassionately, 
and professionally b' rehabilitation practitioners. The 
problem lies in the doubt that these same consumers would 
be able to reliably judge whether or not they have received 
competent services. In addition, Levilan and Taggatt (1982) 
reix)ried that the degree of consumer satisfaction varied with 
such demographic variables as type of disability, age» and 
level of education. 

Consu;r*^r salisfaclion has been examined in a variety 
of rehabilitation settings including rehabilitation counseling 
(Emener & Placido, 1982), sheltered employment (Cooley, 
Sewell & Rich, 1985) and supported employment (Lam, 
1986). Similarly, the concept of "client" satisfaction can 
also be found in the vocational evaluation literature. For 
example, the Vocational Evaluation Satisfaction Scale 
(VESS), an instrument designed to measure consumer 



salisl'action, was recently developed lor use in rehabilitation 
facilities (Sabin, Cuvo, & Musgrave, 1987). "Although 
there was a g^*eat deal of activity in the 1970's in the area of 
consumer satisfaction and most stales have continued to 
collect consumer satisfaction information, there has been a 
paucity of rehabilitation research on consumer satisfaction in 
recent rehabilitation journals" (Patterson & Leach, 1987, p. 
40). The purpose of this study was to explore the 
relationships between consumer satisfaction with vocational 
evaluation and selected consumer demographic variables and 
vocational evaluation program length (Mades, 1986). 

Method 

Participants 

The participants for this study were 154 consumers 
ixsceiving vocational evaluation services at a rural 
comprehensive rehabilitation facility. The participants were 
volunteers who had signed a research consent form prior to 
beginning vocational evaluation services. Approximately 
67% of the consumers were male. Over 60% of the 
consumers were between the ages of 20 and 39, although 
consumer ages ranged from 17 years to 59 years. The 
consumers were diagnosed as having a variety of disabilities 
including visual impairments, hearing impairments, 
orthopedic problems, mental impairments, behavioral 
disorders, learning disabilities, emotional difficulties, 
cardiovascular problems, cerebral palsy, and epilepsy. The 
consumer demographic variablrs, which were obtained 
during the initial intake interview, included (a) disability 
type, (b) gender, (c) age, (d) living situa:ions which 
ir\ -. w^d parental home, rehabilitation centers, own 
apartment or home, half-way houses, nursing homes and 
transitional (or temporary) living settings, 
(e) financial arrangements which included receiving 
Supplemental Security Income (SSI) benefits. Social 
Security Disability Income (SSDI) benefits, no benefits. Aid 
to Families with Dependent Childi'en (AFDC), 
Unemployment benefits, and other public assistance 
benefits, (f) educational level, (g) employment history 
(categorized as never worked, worked one year or less, 
worked two to four years or worked five or more years), 
and (h) quality of previous work (defined as no pay and no 
benefits, pay and no benefits, and pay and benefits). 

Questionnaire 

The Vocational Evaluation Satisfaction Scale (VESS) 
was designed to measure satisfaction with the various 
compone;.vs of a vocational evaluation program by circling 
responses to 34 items. A total score on the VESS was 
obtained by following the procedure described by Sabin, et. 
al, (1987) in which positively stated item answers were 
scored in the following manner; strongly agree-4 points, 
somewhat agree-3 points, somewhat disagree-2 points, and 
strongly disagree-1 point. Reversed scoring system was 
used for negatively phrased items. Since the questionnaire 
coniiisted of 34 items, a client's total score could range from 
34 to 136. Acceptable reli bility and validity coefficients for 
the VESS have been reported (Sabin, et. al.. 1987). 

Procedure 

The VESS was designed to be administered to 
vocational evaluation clients during the final day of 
vocational evaluation services by an evaluator other than the 
one who evaluated the client, refened to here as the proctor. 
In our study, the scale was administered in a room free of 
distractions with the proctor present at all times. The proctor 
asked the client to be seated, and then provided him or her 
with two sharpened pencils and a copy of the VESS. 
Proctor assistance was provided at the request of the client 
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and only wiJiin the Ibllowing established Iramework; 

1 . Reading instructions or items. 

2. Rewording instructions or items. 

The proctor indicated any assistance provided to the client on 
the form after the scale was completed. After five minutes 
had passed, the proctor asked clients if they had any 
questions concerning the scale. Upon completion of the 
scale, the proctor reviewed the pages to insure that all items 
were completed. If items were not answered, the client was 
asked at that time to complete the missing items. 

Consumer satisfaction with vocational evaluation 
services was measured by the VESS and program length 
varied from 2 to 20 days. A preliminary analysis of VESS 
scores established that the consumers were satisfied with 
received vocational evaluation services (M= 122.58, S.D. = 
12.94). No significant differences were repelled in ' 
satisfaction as a function of disability type, E (8, 144) = 
1.64, consumer gender, t (151) = .73, 
employment history, £ (4, 148) = .75, i^., quality of 
previous work, E (2, 151) = 1.29, lu.. and living situation 
L (3, 149) = 1 .87, Similarly, consumer age and 

educational level were not related to individual ^/ESS scores 
both r i <.U, iLi. 

A significant effect for the consumer's financial 
aiTangements, E (5, 147)) = 3.57, c < .01, and follow-up 
Fisher LSD tests (p < 05) revealed that consumei : receiving 
SSI benefits (M. = 114.46) and consumers receiving SSDI 
benefits (M - 1 15.17) were less satisfied with vocational 

^^^^^^^^ consumers receiving no benefits (M 

= 124.79). 

In addition, the duration of vocational evaluation 
services was found to be negatively related lo satisfaction, r 

C < .01. This correlation suggests that as the amount of time 
spent in vocational evaluation increased, satisfaction with 
services decreased. To further confirm this negative 
relationship clients were divided, via a median split, into 
two groups based on (he duration of evaluation services. 
Uients in vocational '^valuation longer than 8 days reported 
le.s.s satisfaction with .crvices (M = 1 16.60) than tho.se 
c icnt.s in evaluation seven or fewer days (M = 124 69) t 
(151) = 3.24,|i< ,01. ' ^"-^ 

Discussinr^ 

The results of the present study suggested that 
consumer satisfaction was not related to most of the 
examined demographic variables. In general, consumers of 
vocational evaluation services indicated satisfaction with 
their individualized vocational evaluation programs One of 
the two variables significanUy influencing satisfaction ratings 
was the consumer's financial arrangements. Further 
examination of the categories within this variable indicated 
that consumers who were receiving some type of financial 
a.ssistance through Social Security (either SSI or SSDI) 
rqwrted le.ss .satisfaction with vocational evaluation services 
Ihaii consmiiers receiving no financial assistance at the time 
of their vocational evaluation program. CUents may have 
feared that vocational evaluation services may result in a lo.ss 
ot ilie.se benefits. Tlie.se financial disincentives have also 
been cited by other authors (Bcrkowitz., 1981; Levitan & 
laggart, 1982) as one of rehabilitation's greatest problems 
and are worthy of additional research, 

For example, it is recommended that further study be 
conducted which explores the relationship between financial 
aiTdiigement and expressed level of satisfaction with 
piollered vocational evaluation services. More stringent 



experimental control should be applied to these studies for 
msiance, exploring the differences in consumer satisfaction 
belween a growp a consumers receiving vocational evaiiiaiion 
servite.s who indicated receiving SSI or SSDI support at the 
time of Intake, and a matched group of consumers who are 
not receiving Social Security benefits of any type at Intake 
In addition, the length of the consumer's vocational 
evaluation program significantly influenced expressed 
satisfaction, Sjxcirically, the longer a client remained in a 
vocalional evaluation program, the lower the VESS score 
ills iinding dws not support the widely held belief that 

olPf ^?^J'''°'lll?'''''''°"'* '"O'e desirable (Wahl, 
1983; Mades, 1986). 

Further research concerning consumer satisfaction is 
needed within the field of vocational evaluation as well a." t e 
ir.K",h^ ^'J'' • ^ vocational rehabilitation. The settin,- 
J^Jo Tr J-l-"^^ '"'y '° ^ laboratory or clinical 

set ng. Traditional paper and pencil psychological tests as 

Z Jc^'Jt'l^ T^- ■^'""P'^ component are adminSed 
to vocational evaluation consumers on a four day per week 
five hours per day schedule. Neither actual nor simulated * 
work tasks were included in individual vocational evaluation ' 
programs, and on-the-job evaluation techniques were used 
sparingly ,f at all It is possible that the obtained remits of 
.his study would be different had simulated, real, and/or on- 
the-job evaluation methods been used as part of the 
vocational evaluation program. 

. It is also recommended that future consumer 

SS^I'.l'"'''!? '?Pu°'* P^".""'''' differences in responses 
obtained at the end of the vocational evaluation program as 
compared to responses obtained during 60-day, or lonoer. 
lollow-up activities. Consumers whose future looked 

m« v?n?^ " 'u ' vocational evaluation services, 
may not be finding that the future is as rosy as anticipated 
and vice versa. Unexpected economic turns, over- 
enrollment in educational institutions, and windfall 
legislauon,are justafewof thefauors which could affect 
satisfaction with services. There are personal factors (e r 
death, marriage, divorce, depression) that could also 

rerSi! S n' ^"'""""^ perception of satisfaction with 
received rehabilitation services. For example, a consumer 
who indicates high satisfaction with the vocational evaluation 

may not be so satisfied with the vocational evaluation 
recommendation if still unemployed 60 days later 
Conversely, a consumer who was dissatisfied with a 
vocational evaluation recommendation that would require 
relocation to another city, at the end of the evaluation 
program, might not mind moving 60 days later if moving 
would mean relocation nearer one's new spouse 

Previous literature has indicated three major areas of 
concern among current methods of evaluating co.isumer 
satisfaction with received services: (a) the exten. of the 
lelatioiiship between desirability of recommendations and 
, "''l''?no<f?^^''f''=°"^"'""^a''''f'»ction (Patterson & 
Uach, 1985) (b) the extent to which consumers are able the 

C^«f> "'"i"?" °^ ^"^i'^" (Patterson & Leach. 
J 985), and (c) the relationship between client satisfaction 
and certain demographic variables such as type of disability, 
•igc. and level of education (Uviian&Taggart 1982) 
According to the results of the present study, the only 
demographic variable showing a significant effect on client 
satisfaction was the type of financial support received by the 
consumer upon enlranc • to the program. Further 

?^^Th"qq?.?^ consumers receiving 

SSI and SSD payments tend to report less satisfaction with 

IS^ins f^r-rr- further investigation into K 

reasons for the lowered satisfaction among Social Security 
benefits recipients is also warranted. Finally it is 
recommended that future program length studies should be 
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expar dcd to include pi'ogrums utilizing situational 
assessment and OJE leciiniques, tlius providing additional 
and possibly useful informaiion for vocational cvahiaiors 
concerned with consumer salislaction. 
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Abstract 

'iTiis study examined the relationship between rehabilitation 
client expressed vocational aptitudes and interests and those 
measured by weU established tests. Results revealed that 
clients have more accurate insight into their interests rather 
than aptitudes. In general, clients were found to over 
estimate many interests and aptitudes in comparison to their 
tested levels. 
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The need to accurately identify an individual's 
vocational aptitudes and interests while in a vocational 
evaluation program has received a great deal of attention in 
the rchabilitauon literature (Berven. 1984; Bolton, 
Brookings. Taperek, Rowland. Cook. & Short, 1980; 
Goleman. 1980; Pniitt, 1986). The identification of these 
aptitudes and interests has historically been attempted 
through a variety of metliodologies such as counseling, 
aptitude test batteries, and interest inventories (Anastasi. 
1988; Zytowski. 1982). In sp:!e of the National Educational 
Association s 1972 moratorium on the use of standaidized 
intelligence, aptitude, and achievement tests, a 1981 survey 
found that "93% of the reporring schools at some time 
administered at lea* ne vocational aptitude or interest 
inventory to all stuc4onts in grades 7-12" Zytowski. 1982. 
p. 16). Clearly, regardless of the questions raised about 
them, standardized interest and aptitude tests have received 
acceptance in vocational assessment so as to eclipse other 
methodologies such as woifc samples, situational 
assessment, and self-reporting techniques (Robbins. 1980; 
Zytowski, 1982). Among these less favored methodologies, 
the following studies have examined the use of self-report 
techniques to identify vocational apdtudes and interests. 

Stewart, Davis, Wilson, and Porter, (1981) 
compared expressed versus tested vocational interests 
between 200 incarcerated and non-incarcerated adolescents 
using the California Occupational Preference System 
(COPS). The authors worked from the assumption that 
vocational interests can be expected to have gained stability 
by adolescence. They found that non-incarccrated youths 
indicated a greater degree of congniity between tested and 
expressed interests than those youths who were incarcerated. 
Even so, the non-incarcerated group differed between tested 
and expressed interests on 63 out of 100 occasions. The 
authon identifled stereotypical Uiinking (e.g., ignoring 
career options to which they have not been exposed) as one 
barrier to the sel^identification of vocational interests. This 
view also tends to be supported by Meyer, Fouad. and 
Klein. (1987) who stated that, with the rapid advances in 
technology, making an occupational choice is "almost 
impossible for die client who may be relatively inexperienced 
and/or naive about the world of work demands" (p. 120). 

After comparing self-expressed interests witii the 
results from the Kuder Occupational Interest Suivcy. 
Nelson (1981) concluded that it was not possible to predict if 
an expressed vocational choice would be confirmed through 
standardized tests. He stated that while it may be common to 
ask a young person what their vocational interests arc, 
"sizable discrepancies between claimed and measured 
vocational interests are not uncommon" (Nelson.1981. p. 

Westbrook (1988) believed that self-estimatcs, while 
useful, provide 'different information tiian actual measures 
of aptitudes" (p. 182). Using the Differential Aptitude Test 
(DAT), he found that students overestimated all their aptitude 
scores. Overall, there was poor correlation between 
estimated and obtained scores. Finally, he reported that no 
higher Uian 50% of the snidents could predict their DAT 
scores within a standard error of measurement. However 
because die data are unpublished, it is difficuli to determine 
how the self-estimated scores were obtained or what benefits 
mny l)c rcccivwl fm«n sclf-csiiinalcs. 
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Three studK.r regarding the agreement of tested with 
claimed interests are reviewed by Cronbach (1984). The 
range of agreement between claimed versus tested interests 
ranged from 33% to 66% among the the studies. Cronbach 
cites several possible explanations for the disagreement 
between self-expressed interests and tested scores. He 
specifically explains that comparisons are difficult because: 
(1) tests measure a wide range of content, (2) an individual 
non nWy compares his/her interests in relative strengths, and 
(3) me differences in the construction of the inventories. 

The purpose of the present study was to examine the 
relationship between rehabilitation client expressed 
vocational aptitudes and interests and those measured by 
well established tests. This will determine if a client 
receiving vocational evaluation services can identify his/her 
vocational apdtudes and interests as accurately as traditional 
testing techniques. 

Methods 

The participants in this study were 42 volunteer state 
VR agency clients receiving vocational evaluation services at 
a comprehensive rehabilitation facility. Qients were 
included for participation if they were: (1) able to read, (2) 
physically able to complete the research instruments, and (3) 
willing to participate in the study. Nevertheless, some 
clients who participated did not finish all sections of the test 
instruments but they were still included in the study based on 
the areas they completed. 

The subjects were 28 males and 14 females. The age 
of the clients ranged from 18 to 51 years old. A diversity of 
disabling conditions were represented in the study. 
Classificadon by primary disability, as indicateu by tlieir 
rehabilitation records, included: 45% oithopedic 
impairment, 36% mental illness, and 19% **other" disabilities 
(these included mental retardadon, visual impairment, or 
neurologiced disorder). A review of the subjects* work 
histoiy indicated that 52% of the clients had been 
competitively employed for over 5 years, 45% of the clients 
, had been competitively employed less than 5 years, and 3% 
of the clients had no prior work history. 

Instruments 

GATB . The standardized instrument used for 
measuring client vocational aptitudes was the General 
Aptitude Test Battery (United States Department of 
Labor,1979). This test is composed of 12 subtests that 
convert into the following nine aptitude areas: general 
intelligence, verbal, numerical, spatial, form perception, 
clerical perception, motor coordination, finger dexterity, and 
manual dexterity. Parker (1987) stated that "research over 
several decades has yielded extensive validity and reliability 
data that support the contention that the GATB is 
unsurpassed as a vocational aptitude battery" (p. 88). Tlie 
GATB, of all multiple aptitude test batteries, is considered to 
have the best validity research linking test scores to job 
performance (Keesling, 1985). Additi-^nally, extensive 
research has strengthened the argument for using this 
instrument with different handicapped populations (Droege, 
1987). 

\ ] S^E^ Intere?:t Inventory . Vocational interests were 
assessed in the present study by the USEvS Interest liveniory 
(United States Department of Labor, 1981). Tliis interest 
inventory is considered a highly reliable and valid measure 
of the following 12 vocational interest areas: artistic, 
scientific, plants and animals, protective, mechanical, 
industrial, business- detail, selling, accommodating, 
humanitarian, leading-influencing, and physical pcrfoiming 
(BoKon, 1985; 1988; Department of Lator, 1982; DrocKC 
1987). lirookintjs and Bolton (1986) idcnlificd this interest 



inventory as "ilie best choice for use with handicapped 
adults" ( p. 174) for identifying vocational interests. 

Self-repon Questionnaires. Questionnaires were also 
developed for the purpose of assessing each clients' self- 
estimated vocational interests and aptitudes. The interest 
self-report questionnaire was formulated using tlic 12 
interest areas and their definitions ai.apted from the USES 
Interest Inventory (Department of Labor,1981). 
Formulation of the aptitude self-report questionnaire was 
adapted from the nine aptitude areas as defined by the GATB 
(Depanment of Labor, 1979). Clients rated each interest and 
aptitude area separately on a five point scale ranging from 
very high ("5") to very low fl"). 

Procedure 

While receiving their initial intake interview at the 
facility, vocational evaluation clients were informed of the 
research study and requested to participate. Upon indicating 
their willingness to participate, clients signed voluntary 
consent forms. Participating clients were given .-erbal 
instructions for completion of the self-report aptitude and 
interest questionnaires. If additional help in completing the 
forms was requested, it was given by die evaluation staff. 
Clients were then, in the course of tiieir vocational evaluation 
program, given the USES Interest Inventory and die GATB 
in counterbalanced order. 

Results and Conclusions 

Scoring . Similar to the self-report questionnaires, 
interest and aptitude test scores on the GATB and USES 
Interest Inventory were transformed into a five point rating 
scale ranging from very high ("5") to very low ("1"). Each 
tested aptitude scort was adapted from die following system 
proposed by McCroskey and Perkins (1984) for aptitude 
rating: Very high (120 and abovc^ ^ "5", high (110 to 119) 
= "4", average (90 tol09) « ''y\ low (80 to 89) « "2" and 
very low (79 and below) » "1". Each interest score was 
consistent witii the USES Inventory manual (Department of 
Labor, 1981) and fell along die following continuum: Very 
High (66-99) = '*5", high (58-65) « "4", average (43-57) = 
"3", low (35-42) = "2", and very low (0-34) = "1". 

Aptitudes . Table 1 presents die correlations and mean 
differences between client self-expressed and GATB tested 
aptitudes. An examination of this table reveals that a 
significant degree of consistency between expressed and 
tested measures was found for only three of the nine 
aptitudes (general, numerical, and spatial). In addition, 
clients indicated significandy higher self-estimated levels 
over tested levels on five aptitudes (general, verbal, motor 
coordination, finger dexterity, and manual de .teriiy). Self- 
expressed clerical perception, however, was found to be 
significandy lower tiian its tested level. 

Interests . T^ble 2 presents the correlations and mean 
differences between client self-estimated and USES Interest 
Inventory tested vocational interests. An examination of 
Table 2 reveals a significant relationship between expressed 
and tested interests in 10 of the 12 interest areas (artistic, 
scientific, plants and animals, protective, mechanical, 
business -detail, selling, humanitarian, leading-influencing, 

and physical perfonning). In addition, clients expres.scd 
significantly higher levels of interest in the areas of artistic, 
plants and animals, protective, mechanical, business-detail, 
accommodating, humanitarian, and leading-influencing than 
indicated by their test results. 

Summary . The present study examined the 
relationship between client sclf-csiim;\tc(l v. *n(iontil iiiicrosis 
and aptitudes with those measured by the USI.ivS hucrcsl 
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Inventory and the GATB, In general, the client's expressed 
interests were consistent with their tested interests 
However, clients overestimated eight of the 12 interest areas 
in comparison to tested interests. Clients appear to be less 
accurate in cstimaring their level of vocational aptitudes. "" 
wiU'i"'.!!"®?'"''; «?'Pi?'"'ed aptitudes, generally, tended to 
J^„d!5. -"J^^^'" '"^'^'"^ These findings arc 

consistent with those reported by others (Nelson,l581; 
Stewart ct. al., 1981; Westbrook, 1988) ind suggest that 
rehabilitation clients receiving vocational evaluation services 
nave better insight into their vocational interests than their 
vocational aptitudes. The data also suggest that clients tend 
to overestimate their levels of vocational interests and the 
strength of their vocational aptitudes. 
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Tabid. 





M Expressed 


M OA ID 


.1 
i— 


r2 


General 


3.21 


0 AQ 


4 29** 


.48** 


Verbal 




2.84 


2.83** 


.17 


Numerical 


2.66 


2.38 


1.89 


.68** 


Spatial 


2.63 


3.03 


1.86 


.34** 


Form Perception 


3.37 


2.97 


1.68 


.02 


Clerical Perception 


2.68 


3.13 


2.39* 


.22 


'Motor Coordination 


3.24 


2.26 


4.64** 


.23 


Finger Dexterity 


3.05 


2.32 


2.93** 


.07 


Manual Dexterity 


3.26 


2.24 


4.55** 


.26 


♦p<.05 ♦♦p<.01 

1. dfs varied from 35 to 37. 

2. df s varied from 35 to 38. 



Tabic 2. 



„ nrt M rn n Riff ft" --- .Srlf-Rstiinated nnt l USES Mcasut cdJnms 





Expressed 


MUSES 




i2 


Artistic 


3.43 


2.49 


4.73** 


.43** 


Scientific 


2.60 


2.54 


.70 


.44** 


Plants &Animals 


3.24 


2.89 


2.10* 


.52*^' 


Protective 


3.55 


2.88 


4.22** 


.39* 


Mechanical 


3.43 


2.98 


2.76** 


.53** 


Industrial. 


2.74 


2.66 


.67 


.20 


Business-Detail 


3.31 


2.63 


4.15** 


.36* 


Selling 


2.69 


2.54 


.88 


.36* 


Accommodating 


3.38 


2.61 


3.96** 


.05 


Humanitarian 


3.71 


2.68 


8.63** 


.71** 


Leading-Influencing 


2.91 


2.39 


3.21** 


.49** 
.33* 


Physical Performing 


2.60 


2.76 


1.03 


'*p<.05 **p<.01 

1. dfs varied from 39 to 40. 

2. df s varied from 38 to 39. 
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Dynamic Performances as Assessed by the BTE Work Simulator 
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Abstract 

Static, dynamic and three endurance measures were 
obtained from young adult females using Tool #162 
of the BTE Work Simulator. The correlations of 
the endurance indices with static and dynamic 
performances were modest, accounting for a small 
proportion of the explained variance. The results 
suggest that a comprehensive assessment of hand 
strength should include endurance as well as 
static and dynamic measures. 



Static measures require an individual to exert 
force against an immovable object. Dynamic 
differs from static performance in that the 
individual moves an object or performs work. 
Because most industrial tasks involve movement, it 
has Ijeen suggested (e.g., Aghazadeh & Ayoub, 1985; 
Kroemer, 1385) that dynamic measures better 
simulate job-related tasks than static measures. 
Although this position is well-taken, dynamic 
measures differ from many job performances in 
several significant ways. One important 
difference in that most dynamic measures are 
obtained in no more than a few trials and that 
many actual jobs require repeated performance cf 
the same response, if a job demands frequent 
emissions of the same response, then a client's 
endurance could be a more critical factor in 
determinirj3 job performance or injury than either 
static or dynamic hand strength. 

Although a reasonable argument can be made for 
endurance measures, they will be of little benefit 
to vocational evaluators unless they provide 
information not available from assessments of 
static; and dynamic performances. The present 
study sought to determine if endurance can be 
reliably predicted from sti^tic or dynamic 
measures. This objective was accomplished by 
correlating static and dynamic performancas on 
Tool #162 of the BTE Work Simulator (BTE) with 
several endurance measures yielded by the same 
instrument. 

If endurance is highly correlated with either 
static or dynamic measures, then very little would 
be learned by assessing endurance. Conversely, a 
low correlation between endurance and static and 
dynamic indices would suggest the possibility that 
vocational evaluators would obtain a more 
comprehensive assessment of hand strength by 
including endurance measures in thuir protocols. 



Method 



^Additional information concerring this article 
can be obtained by writing to the authors at the 
Psychology Department, Appalachian state 
University, Boone, NC 28608. 



Sub jects 

The subjects were 67 female undorgr^duatea 
from Appalachian State University. The 
participants ranged in age from 17 to 26 years and 
none had a hand injury which impaired current 
functioning. 
Instrum ents 

The main components of the BTE are an exeioise 
head that furnishes resistance against which the 
client responds, and a console for setting and 
recording these resistances. Work Sin.ulator Model 
lOlA was used in the present study, it allows the 
^^xercise head to be set at heights ranging from 38 
to 53 in. Performance measures can be obtained 
from a variety of tools that can be inserted into 
the exercise head. NuiT\ber 162 is one of the most 
frequently used BTE tools and has the shape of a 
hand dynamometer, one of the advantages of the 
BTE is that it furnishes both static and dynamic 
measurements. 
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Procedure 

Three static performances were obtained from 
each hand. Approximately 15 seconds Reparated 
static trials to minimize fatigue effects. One 
dynamic trial on each hand was then assessed. 
Procedures recommended by the Baltimore 
Therapeutic Equipment Company (J. Jacobs, personal 
communication, January 1988) wore followed ^n 
ga hering the static and dynamic data. 

Three endurance measures, each desinned to 
indicate the effects of repeated performance of 
the same response, were computed for each subject. 
The first endurance measure was the mean 
performance of Trials 48 to 50. Two other 
endurance indices provided a comparison of the 
client's performance under minimum fatigue to 
performance after a number of trials. The second 
endurance measure, which we will call "absolute 
performance loss/' was determined by subtracting 
the subject's mean static performance from the 
mean performance on Trials 48 to 50, For example, 
let us assume that a subject's mean static 
performance was 210 in. /lb and the mean 
performance on Trials 48 to 50 was 150 in. /lb. 
The mean static performance could then be 
subtracted from the mean of trials 46 to 50 to 
determine the decline in performance. When 
endurance is calculated in this manner, a highly 
negative score indicates a low degree of 
endurance . 

Absolute Loss ^ Mean Trials 48 to 50 - Mean Static 

Absolute Loss « 150 - 210 « - 60 in. /lb 

A third procedure computed the "proportional loss" 
in static strength as a result of repeated trials. 
The formula for proportional loss is 

Proportional Loss = Absolute Loss / Mean Static 

Proportional Loss « - 60 / 210 => - .286 

Results and Discussion 

The primary purpose of this investigation was 
to assess the relationships between static and 
dynamic indices and three measures of endurance. 
Static performance was significantly correlated 
with both right- and left-handed performance on 
Trials 48 to 50 (Appendix A). However, 
statistical bignificance does not necessarily 
indicate that these correlations will allow 
vocational evaluators to accurately estimate 
endurance from static hand strength. Static 
performance explained only 49% of the variation in 
right-handed scores on Trials 48 to 50 and only 
50% of the variation in left-handed scores. The 
association of the dynamic measure to performance 
on Trials 48 to 50 was also weak, accounting for 
31% of the variance in right-handed and 16% of the 
variance in left-handed performance. 

The correlations of static and dynamic 
performances with the absolute and proportional 
loss measures were lower than with performance 
over Trials 48 to 50. Significant negative 
correlations were found between static performance 
and the absolute loss index. However, the 
coefficient of determination was only (.24) for 
the right hand and (.09) for the left hand. The 



correlation of dynamic performance with the 
absolute loss endurance measure did not obtain 
significance. Neither static nor dynamic 
performances ware cignif icantly correlated with 
the proportional loss measure. 

These results indicate that neither static nor 
dynamic measures reliably estimate any of the 
endurance indices used in this study. In other 
words, endurance measures furnish vocational 
evaluators with information that cannot be gained 
from either static or dynamic performances. 

A question could be posed concerning the most 
useful index of endurance. We doubt research will 
ever find a single measure that is "best" for all 
situations. Endurance is a very rich concept, 
which should not be limited to a solitary index. 
Only three simple endurance measures were examined 
in the present study. Other, potentially 
important, indices could be extracted from the raw 
data. For example, a measure of variability and a 
slope could be easily computed across endurance 
trials. Other endurance testing procedures should 
also be investigated. For instance, endurance 
could be assessed by a series of dynamic trials. 
Alternatively, clients could be required to 
maintain a steady force for as lon<i as possibJ.e* 
In addition, the decline in force following a 
single maximal exertion could be plotted. 

In sum, endurance measures yielded information 
that was not redundant with static or dynamic 
indices. These results provide support for the 
position that a comprehensive analysis of hand 
strength should include endurance as well as 
static and dynamic measures. The next logical 
question to be posed is: What value is this 
information provided by em \rance assessment to 
vocational evaluators? Unfortunately, the same 
question can be asked of the more commonly used 
static and dynamic measures. Certainly, there are 
many vocational evaluators who are convinced that 
h£Z static and dynamic assessments are helpful* 
No doubt, these evaluators have thoughtful 
rationales underlying their conclusions. We too, 
can make a reasonable argument for the need for 
endurance measures. However, reasoning and 
consensus among evaluators are weak stibstitutes 
for empirical data. We are of the opinion that 
the BTE has significant potential as an assessment 
device. Still, the value of an evaluation 
instrument cannot exceed the research upon which 
it is based. We look forward to and encourage 
studies that establish the empirical validity of 
static, dynamic and endurance measures using the 
BTE. 
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Appendix A 

-R-^lat^Lon^sh^^ endurance 



Right Hand 



Means and Standard Deviations 



STATIC 
MEAN 211.68 
SD 45.60 



TRIALS ABSOL 

DYNAMIC 48-50 LOSS 

2747.00 151.11 -60.57 

Q84.09 41.37 33.78 



PROP 
LOSS 

-.28 

.14 



S.linple Correlations Coefficients of Determir.ction' 



STATIC 
STATIC 1,00 

DYNAMIC 



TRIALS 
48-50 

ABSOL 
LOSS 



DYNAMIC 

.64'** 
(.41) 



TRIALS 
48-50 

.70*'* 
(.49) 

.56** 

^31) 



AfiSOL 
LOSS 

-.49** 
(.24) 

-.18 
(.03) 

.28* 
(.08) 



PROP 
LOSS 

-.17 
(.03) 

.04 
(.00) 

.57** 

(.33) 

.93*'* 
;.86) 



Left Hand 



Means and Standard Deviations 



STATIC 
MEAN 195.19 
SD 35.93 



TRIALS 
DYNAMIC 48-50 

2399.09 130.38 

723.62 38.55 



ABSOL 
LOSS 

•64.81 

26.56 



PROP 
LOSS 

-.33 

.15 



Simple Correlations Coefficients of Determination 



STATIC 
STATIC 1,00 

DYNAMIC 



TRIALS 
48-50 

ABSOL 
LOSS 



DYNAMIC 

.45**' 
(.21) 



TRIALS 
48-50 

.71** 
(.50) 

.40** 
(.16) 



ABSOL 
LOSS 

-.30** 
(.09) 

-.02 
(.00) 

.46** 

(.21) 



PROP 
LOSS 

.09 
(.00) 

.15 
(.02) 

.75** 
(.57) 

.91*'^ 
(.82) 



?^ib^^g^n:m?S^^ifean^ ^ri^^s 48-50, and Absolute Loss were measured in 

•coefficients of determination are in parentheses. Number of subjects = 67 

"e < .05. **e < .01. 
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Abstract 

Multiple regression procedures generated equations 
to estimate the magnitude of performance loss duo 
to injury. Examples were presented illustrating 
how these equations can be used with Tool #162 of 
the BTE Work Simulator to assess loss in static 
and dynamic strength following an injury. 



^Additional information concerning this article 
can be obtained by writing to the authors at the 
Psychology Department, Appalachian State 
University, Boone, NC '^8608. 

'In the present study, the magnitude of impairment 
or disability will refer to performance loss on an 
evaluation instrument following an injury. 



A nineteen year-old seamstress from North 
Carolina recently injured her right hand in a 
factory accident. A lawsuit followed concerning 
the compensation that she was entitled to receive. 
The central issue was the magnitude of impairment 
caused the accident.^ 

A physician was employed as an evaluator by 
lawyers representing the factory owners' insurance 
company. He assessed the seamstress and 
determined that her, disability was 10%, The 
measurement procedures he followed in deriving 
this figure were never specified. We were 
employed by the seamstress' attorney to evaluate 
his client and establish the effects of the injury 
on her manual abilities. 

Before the extent of impairment due to an 
injury can be determined, it is necessary to: 1) 
assess the client's current performance, and 2) 
estimate performance on the same evaluation 
instrument prio* to injury. Performance loss can 
then be calculated by subtracting the estimated 
preinjury performance from the current 
performance. 

Circumstances specific to the caso indicated 
that static hand strength would provide a useful 
index of performance. Assessing the seamstress' 
current static hand strength was not difficult. 
But how could we determine what the seamstress' 
hand strength was before the onset of disability? 
The question is not only of great applied 
iit^rtance, but also conceptually intriguing. How 
can we measure what no longer exists and may never 
exibt again? 

At the Third National Forum on Issues in 
Vocational Assessment, we (Sigmon & Beck, 1988) 
demonstrated how multiple regression techniques 
can be used to generatp equations that provide 
accurate estimates of px ry performance on the 
Jamar hand dynamometer, eated the seamstress 

and used these equations to -iscover what her 
score would have on the Jamar before the accident. 
The seamstress' preinjury performance was then 
compared to her current Jamar performance, 
revealing that the injury produced a 50% loss in 
hand strength. These findings were reported to 
the seamstress' attorney. Largely on the basis of 
these data, an out-of-court settlement, favorable 
to the seamstress, was reached. 

The methodology used to estimate preinjury 
Janiar performance can be applied to a variety of 
assessment i truments and impairments. This 
paper describes how multiple regression can 
furnish objective estimates of preinjury static 
and dynamic hand strengths on Tool #162 of the BTE 
Work Simulator (BTE). Weight, height, hand 
volume, hand dominance, sex, and performance on 
the noninjured hand were the independent 
variables. These variables were chosan because 
there was a high probability that the/ would be 
correlated with the dependent measures, and they 
could easily be recorded by most vocaaonal 
evaluators. A sample of persons who had never hrd 
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a serious hand injury was used 'to obtain the 
regression weights. This approach assuities that 
the relationship of independent to dependent 
variables is similar for noninjured persons and 
for injured persons prior to their debilitation. 

Method 

Subjects 

One hundred and ninety-two female and 108 male 
Appalachian State University undergraduates served 
as subjects. The participants were between 18 and 
25 years of age, and none had a serious hand 
injury that ijiqpaired thair performance. The 
students received course credit for their 
involvement in the inveotigation. 

The data fxom 4 other persons was not included 
in the analysis because they had previously 
incurred a hand injury that could have affected 
their performances. 
Procedure 

The subject was taken by the evaluator to a 
3,11 X 2«95 ro room containing the testing 
equipment. The subject wab asked if there was a 
history hand or wrist injury. Detailed notes were 
made regarding the nature of any reported injury. 
The first author used these notes to determine if 
an injury was sufficiently eevere to preclude 
inclusion in the data analyses. 

Height and weight were measured on a 
Health-o-Neter manufactured by the Continental 
Scale Com^ny. The sex of the subject was noted, 
and hand dominance was asaertained« Hand 
dominance was determined by asking the subject 
which hand was used for writing. 

The subjects were then assessed usipg Hand 
Volumeter Set #3511 (Volumeters Unlimited). This 
test requires the individual to gradually imr^trse 
the hand until fingers straddle a rod situated in 
the beaker. Hand volume was indicated by the 
amount of water displaced. The right hand was 
measured, then the left hand. 

Three urials of static and one trial of 
dynamic performance were obtained from each hand 
using Tool #162. The investigators followed 
testing procedures recommended by the Baltimore 
Therapeutic Equipment Company (J. Jacobs, personal 
coniminication, January 1988). 

Results 

Reliability coefficients were calculated to 
determine the consistency of static performance 
across trials. Alpha coefficients (Cronbach, 
1951) were .990 for right hand and .991 for left 
hand static performance. Mean static scores were 
used in all following analyses, because the 
reliabilities were high. 

Multiple regressions were computed to estimate 
preinjury right hand ststic, left hand static, 
right hand dynamic and left hand dynamic 
performances. Separate equations were developed 
to estimate the preinjury performance of clients 
with injuries to one (Appendix A) and both hands 
(Appendix B). Equations estimating the BTE scores 
of persons with injuries to one hand used weight, 
height, hand volume, hand dominance, sex, and 
performance on the noninjured hand as independent 
variables. Estimations of the preinjury 
performances of persons with injuries to both 



hands used the same independent variable*^, except 
that performance on the noninjured hand and hand 
voiuine were not tested for inclusion in the 
equations • 

The variables were regressed using a forward 
solution. Only those independent variables that 
produced a significant increase in the explained 
variance were included in the regression 
equations. A .05, level of signif ica.ice was used 
in testing the variables. 

The Appendixes indicate that each of the 
equations accounted for a substantial proportion 
of the variabiliti' between subjects. The 
coefficients of determination ranged from .843 to 
.915 for estimates of the preinjury performance of 
persons with an injury to one hand and from .564 
to .770 for estimates of the preinjury performance 
of persons with an injury to both hands. Also, 
equations estimating preinjury static performance 
accounted for more of the variance than equations 
estimating preinjury dynamic performance. 

Discussion 

To demonstrate the use of the equations in the 
Appendixes, let us see how a vocational evaluator 
would determine loss in dynamic hand strength 
following an accident. The client in our example 
is a female industrial worker with a disability to 
the right hand. 

The first step in the evaluation is to obtain 
an estimate of the client *s hand strength before 
the accident. Regression 2 in Appendix A contains 
a list of those variables that are needed to 
estimate the preinjury right hand dynamic 
performance. Left dynamic, weight and hand 
dominance produced significant increments in the 
explained variance and were included in the 
equation. 

The evaluator tested the worker and found her 
left hand dynamic performance to be 2070 engals. 
Her weight was 112 lb and she was right hand 
dominant prior to the accident. The notes below 
Appendix A provided the therapist with the 
numerical code assigned to the hand dcninance 
variable (right handed - 1). The notes also 
indicate the units of measui.*ement and codes used 
to assess other variables. 

The values for left dyntaic performance 
(L DYWAMIC), weight (WT) , and hand dominance (DOM) 
were inserted into the regression equation. An 
estimate of the worker's right hand dynamic 
strength prior to her disability was obtained 
after a few calculations. 

6.696 +.962(L DYNAMIC) +4.669(WT) -288. 550(DOM) ^ 

6.696 + .962(2070) + 4.669(112) - 286,550(1) - 

6.696 + 1991.340 522.928 - 288.550 = 2232.414 

Appendix A also shows that the regression 
equation estimating preinjury right hand dynamic 
performance is highly significant. Thq 
coefficient of determination (R^) reveals that the 
equation accounts for 84% of the variance in 
subject's scores. High coefficients of 
det<irmination, such as this one, indicate that the 
equation yields an accurate estimate of preinjury 
performance. 
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In the caae of the industrial worker, the 
purpose of the evaluation was to discover the 
magnitude of strength loss resulting from the 
accident. This required a comparison of her 
current strength to her estimated strength before 
her impairment, she was aaaesBed Oii Tool #162 and 
her current dynamic strength was 1065 engals. k 
difference of 1167.41 engals was found between her 
current and her estimated prainjury perfornjances. 



Current 
Performance 



Preinjury 
Performance 



Loss in 
Performance 



1065 - 2232.414 « -1167.414 

Only a few computations were requireJl to 
determine the per c«nt of her dynamic strength 
lost as a result of the accident. 



Performance Loss 
Proinjury Performance 



100 » Per Cent Loss 



"1167.414 



2232.414 



* 100 « -52.294% 



The evaluator has now accurately eatimated the 
extent of disability caused by the accident. 
Hopefully, our demonstration has shown how easy it 
is to apply these equations and BTE users are 
thinking of situations in which objective 
asaessmenta of performance loss would be helpful. 
However, we must be wary that the ease with which 
these equations can be calculated does not lead us 
to neglect certain sound evaluation practices. 
Several cautions must be observed in order to 
avoid assessment errors. 

The equations should not be used if the injury 
substantially Impacted the predictor variables. 
For instanot, e large change in weight following a 
disability would result in errors in the 
estimation of preinjury performance. The 
equations should also not be applied if d 
compensp.tory increase in the strength of the 
nonimpaired hand has occurred following the 
injury. 

Evaluators should restrict the use of the 
equations to clients who are similar to the 
persons In the nample. Our sanqple was composed of 
young adults. At present, we do not know if 
similar regression coefficients would be found 
with a sample of older adults. Research is needed 
to assess the extent that equations estijnating 
preinjury performance are age-specific. Ideally, 
the samples used in these studies should be 
diverse, and age should be a variable tested for 
inclusion in the regression analysis. 

We hope that this will be one of the first in 
a series of investigations which will provide 
vocational evaluators with increasingly precise 
estimates of performance loss due to injury. The 
methodology and statistical procedures used to 
generate these equations have greet generality and 
should not be confined to the BTE and Jamar. 
Equations should be developed to estimate 
performance loss with other assessment 
instruments, client populations and disabilities. 



For instance, multiple regression can be used to 
estimate the magnitude of injuries to arms, logs 
and the back. Investigations reilizing the 
potential of this methodology will create a new 
tool, giving us the power to objectively determine 
performance loss caused by accident or injury, 
These studies will move us a step further from 
reliance on subjective opinion and a step closer 
to a science of vocational assessment. 
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Appendix A 

Multiple reqres? ions estimating the preinjury performance of persons with an injury to one hand 



Regression Equation 



Re' jfressiort 1: Estimate Right Static 
Step 1 

8.151 + 1.054 (L STATIC) 
Step 2 

- 40.925 + .943 (L STATIC) + .182 (LV) 
Step 3 

8.587 + .895 (L STATIC) + .158 (LV) - 16.308 (SEX) 

Regression 2: Estimate Right Dynamic 
Step 1 

225.074 + 1.005 (L DYNAMIC) 
Step 2 

- 267.543 + .956 (L DYNAMIC) + 4.533 (WT) 
Step 3 

6.696 + .962 (L DYNAMIC) + 4.669 (WT) - 288.550 (DOM) 

Regression 3: Estimate Left Static 
Step 1 

17.131 + .860 (R STATIC) 
Step 2 

91.808 + .761 (R STATIC) - 28.653 (SEX) 
Step 3 

77.089 + .7154 (R STATIC) - 28.871 (SEX) + 15.570 (DOM) 

Regression 4^ Estimate Left Dynamic 
Step 1 

353.390 + .833 (R DYNAMIC) 
Step 2 

- 812.482 + .714 (R DYNAMIC) + 3.696 (RV) 
Step 3 

413.334 + .686 (R DYNAMIC) + 2.473 (RV) - 366.196 (SEX) 
Step 4 

146.128 + .687 (R DYNAMIC) + 2.331 (RV) - 361.122 (SEX) + 289.817 (DOM) 



R^(Chn) 



.907*** 
.912*** 
.914*** 

.837**" 
.841*** 
.843*** 

.907*** 
.913*** 
.915^** 




.907*** 
.005*** 
.002* 

.837*** 

.004** 

.002* 

.907*** 
.006*** 
.002** 

.837*** 
.015*** 
.005** 
.003* 



Note. L * Left. R = Right. WT « Weight. DOM » Hand dominance prior to injury. The following units 
ormeasurement and codes were used: Static, in. /lb; dynamic, engals;^ WT, lb; RV, cc; LV, cc; SEX, 
Males = 1, Females = 2; DOM, Right handed *= 1, Left handed = 2. 

R=» » Coefficient of determLiation of the regression equation. R^(Chn) = Coefficient of 
determination of the change in the regression equation. 

*e < .10. **e < .05. ***E < .01. 
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„ , , , Appendix B 

Multi£le_^gare ssions estin^atinc; the prelnjur y performance of persons with an ininry i-n h^.h 



Regression Equation 



Regression 1: Estimate Right Static 
Step 1 

- 227.304 + 1.186 (LV) 
Step 2 

- 166.803 + .683 (LV) - 108.996 (SEX) 
Step 3 

42.945 + .651 (LV) - 102.266 (SEX) + 1.896 (HT) 
Step 4 

- 28.933 + .868 (LV) - 92.502 (SEX) + 2.583 j(HT) - .571 (WT) 

Regression 2: Estimate Right pynarnic 
Step 1 

- 3517.474 + 16.526 (LV) 
Step 2 

1048.620 + 10.701 (LV) - 1262.816 (SEX) 

Regression 3: Estimate Left statin 
Step 1 ~ ~ 

544.095 ~ 174.141 (SEX) 
Step 2 

181.676 - 10;:.839 (SEX) + .571 (RV) 
Step 3 

158.417 - 95.958 (SEX) + .766 (RV) - .494 (WT) 
Step 4 

14.318 - 87.057 (SEX) + .779 (RV) - .628 (WT) + 2.146 (HT) 
Step 5 

- 2.481 - 87.003 (SEX) + .769 (RV) - .627 (WT) + 2.063 (HT) + 24.122 (DOM) 

Regression 4; Estimate Left Dynamic 
Step 1 

- 3301.256 + 15.402 (RV) 
Step 2 

939.883 + 10.013 (RV) - 1173.639 (SEX) 



.756*-'* 
.760*"" 
.765'*-* 

.513**" 
.564-** 

.670'*** 
.753*** 
.759--* 
.765*-* 
.770*** 

.561**- 
.612*** 



R^(Chn) 



.660*** 
.095*** 
,004* 
.006** 

.513*** 
.051*** 

,670'*" 
.084*** 
.U06** 
.006** 
005* 

.561*** 
.051*** 



^ - Left. R « Right. WT - Weight. HT « Height. DOM « Hand dominance prior to injury 
following units of measurement and codes were used: static, in. /lb; dynamic, engals; WT, 
RV, cc; LV, cc; SEX, Males = 1, Females 2; DOM, Right handed = 1, Left handed = 2. 

R' - Coefficient of determination of the regression eqi^ation. R=(Chn) = Coefficient of 
determination of the change in the regression equation. 

*t < .10. **e < .05. **-2 < .01. 



The 
; HT, in. , 
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A comparison of Static and Dynamic Strength as Measured by the BTE and WEST A 



Karen Youngblood Kim Ervin Gary Sigmon Hall Beck 
Appalachian State University 



Abstract 
The present study compared 
assessments made on two evaluation 
instruments used to measure torque, 
BTE and WEST 4. The similarities 
and disimilarities between static 
and dynamic measures were also 
investigated. There was no 
significant relationship found 
between measures taken on the BTE, 
static or dynamic, and measures 
taken on the WEST 4* This suggests 
that these two instruments, which 
are often assumed to be measuring 
the same ability are actually 
measuring very different things, a 
fairly high significant correlation 
was found between static and 
dynamic measures taken on the BTE. 
Although this relationship was 
high, less than 50% of the variance 
between the two measures was 
shared. This suggests that in 
assessment, as in conditioning, 
both static and dynamic measures 
are neccesary to provide a 
comprehensive measure. 
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A Comparison of Static and Dynamic 
S'rength as Measured by the 

BTE and WEST 4 
An individuals ability to apply 
torque is an often measured 
attribute in physical capacity 
evaluation and in occupational 
therapy practice. Two commonly 
used instruments to assess torque 
are the Work Evaluation Systems 
;f,noi;i°"^°^y Maximum Torqueing Test 
(WEST 4) and the Baltimore 
Therapeutic Equipment work 
Simulator (BTE). The WEST 4 Work 
Capacity, Evaluation Device ~ uiiF 
Manual (1987) defines torque al~^ 

V^r^l^'l* M^?*' produce 
rotation" (p. 17). For example, a 

torqueing motion is required to 
turn a door knob, or to use a 
screwdriver. The BTE user manual 
defines torque as "a twisting 
force' (p. 44). BTE uses the 
example of a person applying torque 
to their watch stem when they wind 
their watch. This paper proposes 
to investigate the similarities and 
differences of these two apparently 
similar assessment devices and the 
abilities which they measure. 

Another facet of the present 
study was to examine the 
similarities and differences 
bet^^een static and dynamic torque 
measures. Although there is little 
empirical evidence demonstrating 
the difference or similarities 
between dynamic and static strength 
assesssment, the literature 

suggests definite differences in 
the benefits derived from isometric 
static) versus isokenetic 

(dynamic) conditioning (Pipes, 
ly//; Asmussen, 1981). For 
ej^ample. Pipes (1977) reported that 
isometric training may be 
ineffective in increasing actual 
?iQfl7? performance. Asmussen 

v\llJ /^P°^ted that "... in both 
kinds of exercise, force (tension) 
IS produced, but only in dynamic 
exercise is work performed also" 
(P-I-3). Therefore, it is 

reasonable to assume that the most 
proper assessment procedure for 
work evaluation would he a dynamic 

Static and dynamic measurpc: 
have both been obtained fSr^^'ny 
years even though there is a 
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paucity of information comparing 
various vocational instruments that 
assess the two. One study by 
Hunsicker and Greey (1957) reported 
that there is a difference between 
static and dynamic strength but 
maintained that the relationship 
between the two is low. One 
obstacle in making such comparisons 
is that most vocational assessment 
devices do not yield both static 
and dynamic measures of 
performance. One advantage of the 
BTE is that it evaluates both 
static and dynamic functioning. 
The present study compared static 
and dynamic measures using tool 
#502 of the BTE and static and 
dynamic measures of the RTE with 
performance on the WEST 4, which 
yields a measure that is dynamic in 
nature (L, N, Matheson, personal 
communication, February 27, 1989). 

Method 

Subjects 

The subjects were 62 females 
enrolled in psychology courses at 
Appalachian State University. The 
ages of the participants ranged 
from 18 to 25 years. If the 
subjects reported any history of 
serious hand injury it was 
confirmed by the experimenter that 
the injury no longer hindered the 
subject's performance. The 
students received extra course 
credit for participating in the 
investigation. The data from 3 
other women were not included in 
the analysis, because they had 
sustained a serious hand injury. 
Procedure 

The testing was performed in 
two adjoining rooms, one containing, 
the BTE, and the other containing 
the WEST 4. The evaluators 
questioned the subject to find if 
there was a history of hand injury. 
Hand dominance was determined by 
asking the subject which hand was 
used for writing. Weight and 
height were measured then the sex 
and age of the subject was 
recorded , Half of the subj ects 
were then tested on the PTE and 
then the WEST 4, The remaining 
subjects were evaluated on the WEST 
4 before the BTE. Approximately 30 
minutes seperatod hoshinq on the 



(:wo assussment devices to minimize 
fatigue effects. 

The WEST 4 was administered 
according to instructions contained 
in the WEST 1 Work Capacity 
Evaluation De vice User ^laiIual 
(1987), The apparatus consists of 
six identical compression tubes 
mounted on a square steel 
crosspiece. The WEST 4 was secured 
to a table with the compression 
tubes 1.04m above the floor. Each 
compression tube contained a spring 
that the subject tightened with a 
nutdriver. As the subject rotated 
the nutdriver, the evaluator 
gradually increased resistance by 
tightening an adjustment screw on 
the compression tube. The 
evaluator measured maximum output 
with a torque wrench when the 
subject could no longer turn the 
nutdriver. Three pronation trials 
were conducted with each hand. The 
subject was tested with a ruler 
between the arm and torso to reduce 
superfluous body movements . 
Approximately 15 seconds seperated 
trials . 

The BTE was administered 
according to instructions contained 
in the protocol for the Baltimore 
Therapeutic Equipment Work 

Simulator Upper Extremity 

Evaluation . Static and dynamic 
pronation measures were taken from 
each hand using tool #502, For the 
static exercise three pronation 
trials were recorded for each hand. 
The subjects were positioned witii 
their elbow at approximately 80 
degrees flexion and their feet 
shoulder width apart. A template 
was placed between the arm £nd 
torso to minimize superfluous body 
movements. The BTE was set in the 
"manual static" mode for this 
exercise. The subjects were 
instructed to "turn the screwdriver 
handle gradually as hard as they 
could even though it would not feel 
as if it were moving". 

The scores for the three trials 
were averaged and then divided by 
two to determine the exercise level 
for the dynamic assessment. After 
the exercise level was set for the 
subj ect , they were repositioned . 
At this time they were instructed 
to turn the tool as fast as thoy 
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could for 10 seconds after which 
they would be instructed to stop 
and take their hand off of the tool 
as quickly as possible. They were 
allowed to turn the tool twice to 
become comfortable with the 
resistance before beginning the 
exercise. 

Results 

The results were analyzed 
seperately for each hand. For both 
hands the correlations between 
static and dynamic performance on 
tool #502 of the BTE were 
statistically significant, 



Insert Table 1 about here 



indicating that the two measures 
were related ♦ However , the omega 
square was moderate, less than 50% 
of the variance in dynamic BTE 
scores could Le accounted for by 
knowing an individual's static 
performance. This outcome is 
consistent with the findings of 
Hunsicker and Greey (1957) and 
other investigators who have 
contended that both static and 
dynamic measures are necessary to 
provide a thorough analysis of 
manual strength. 

Reliability coefficients 
(Cronbach^s alpha) were calculated 
for all repeated measures on the 
WEST 4 and the static measures for 
the BTE. tioth instruments provided 
highly reliable measures. On the 
WEST 4 the alphas were .94 and .97 
for the right and left hands, 
respectively. Alphas of .91 and 
♦95 were found for the right and 
left he^.L measures on the BTE tool 
ff 502 static measures. 

The most interesting finding 
concerned the relationship of WEST 
4 scores to static and dynamic 
performance of the BTE. The WEST 4 
performance scores were only 
slightly correlated with BTE static 
and dynamic performance scores on 
the right hand measures, and there 
was no relationship between left 
hand scores taken on the WEST 4 and 
BTE static and dynamic left hand 
scores, A modest though 

nttil-.ifil-.i cnl ly s i.cjnir.i canL 



correlation was found between WEST 
4 and BTE static measures taken on 
the right hand and there was no 
relationship between WEST 4 and BTE 
static measures taken on the left 
hand. The correlation between the 
WEST 4 and BTE dynamic performances 
did not achieve statistical 
significance for the left hand, 
however the right hand scores were 
significantly correlated, but again 
the relationship was small. 

Discussion 
These findings provide a 
graphic illustration of the dangers 
of relying on face validity. 
Certainly, assessments using (*he 
BTE tool #502 and WEST 4 Maximum 
Torqueing Test have a strong face 
validity and are supposedly both 
measuring the same ability, torque. 
This leads to the inaccurate 
assumption that the performance 
scores on the two evaluation 
instruments are highly related. 
However, the data clearly indicates 
that the abilities assessed by the 
two testing devices have little in 
common. Less than 10% of the 
variance was shared between BTE 
static and WEST 4 scores. We found 
little evir^mce to suggest that 
th ire was a strong relationship 
between BTE dynamic and WEST 4 

It is clear that thcj mh\ and 
WEST 4 are measuring very different 
abilities but, it is unclear as to 
exactly what those abilities are. 
Unfortunately , the empirical 

literature does not ^eveal the 
abilities that either instrument 
assesses . Before definitive 

answers to these questions can be 
found, much additional research is 
needed to relate both BTE and WEST 
^ performance measures to some 
identif irible external criterion . 
Ideally this criterion should be a 
widely accepted, valid, and easily 
measurable construct , such as 
intelligence or self-esteen. Until 
such validity informet- ion is 
available , the judgemer. .:s and 
\eccomendations made on the basis 
of BTE and WEST 4 a^^sessments are 
not readily defensible. 

Althouqh these findings raised 
qucsl.ionn irognrd incj the concurrant 
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validities of both the BTE and WEST 
4, the therapeutic value of these 
instruments is :iOt diminished. 
Both assessment or therapeutic 
devices have been found to be quite 
reliable thus enabling the 
therapist to use initial 

assessments as benchmarks for 
therapeutic gain. Problems arise 
when assessments made on one of the 
devices is recorded and progress 
noted when switching to the other 
piece of equipment as in facilities 
where both tools are being used. 
When initial assesssments are made 
using one tool and therapy 
initiated using another, progress 
cannot be justified on the basis of 
the initial evaluation. 



Asmussen, E. 
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Table 1 

Correlations between assessments 
made on the BTE tool #502 and the 
WEST 4 



WEC 


R502S 


L502S R502D 


L502D 






.23 


WEA .83 


.33 


.24 .30* 


WEC 


.09 


-.08 .04 


-.07 










R502S 




.80 .68 


.63 










L502S 




.65 


.65 










R502D 






• 86 


Note: 


WEST 4 


and BTE static 


scores 


were measured 


in inch pounds. 


BTE 


dynamic 


scores 


were measured 


in 



engals . 



.01 
.001 



Value Labels 
WEA = WEST 4, Right Hand, Pronation 
WEC = WEST 4, Left Hand, Pronation 
R502S = BTE, Right Hand, Static 
L502S = BTE, Left Hand, Static 
R502D = BTE, Right Hand, Dynamic 
L502D = BTE, Left Hand, Dynamic 
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SlTH T^ SCREENING AND ASSESSMENT (MESA) 

WITH THE GENERAL APTITUDE TEST BATTERY (GATB). DIFFERENTIAL APTITUDE TESTS (DAT) 
AND THE TESTS OF ADULT BASIC EDUCATION (TABE) ^ 



TIMOTHY P. JANIKOWSKI 
JAMES BORDIERI 
JACK MUS6RAVE 



Abstract 

This study eatimoted the construct validity of 
MESA generated aptitude, academic achlovemnnt, 
and general educational dovelopient (GEO) scores 
by comparinc: them to corresponding acoros 
produced by the GATB, DAT, and TABE. 
Correlational evidence was found to support the 
construct validity for most of the aptitude and 
academic achievement components of the MESA. 
MESA produced math scores as well as numerical, 
form percijption, and clerical aptitude scores 
were not. however, related to similar scores 
produced by more well established instruments. 
Implications for future refinement and 
validation of the HiSSA are discussed. 



The Microcomputer Evaiuation Screeninfr and 
Ashessment (MKGA) is one of the most popular 
computer-based vocational evaluation systems 
used today, having been sold to over 1,800 
rehabilitation and related facilities (personal 
communication, P. Rathstntter, May 17, 1988). 
The MESA system represents a substnntial 
investment for the consumer; a single station, 
without a computer, costs approximately $4,000. 
Despite its popularity and cost, published data 
supporting its validity are scarce (Dotterbusch, 
1987). 

The MESA is touted as a criterion- 
referenced device and its developers rely 
primarily upon content validation and 
intercorrelations among MESA scorec to support 
its construct validity. Valpar suggests that 
8 nee the MESA is criterion-referenced, rather 
than norm-referenced, correlations between it 
and other measures are unimportant or even 
irrelevant. A number of authorities recommend, 
however, that criterion-referenced tests be 
ovaluMtfHi against, other measures in order to 
determine construct validity (Berk, 1984: 
Cronbach, 1971, • Hambleton. 1984; Linn. 1980; 
Messlck, 1975) . 

The purpose of the present study was to 
estimate the construct validity of the MESA's 
aptitude, academic achievement, and General 
Educational Development (GED) scores by 
comparing them to corresponding scores on othnr 
instruments. Three well established instruments 
were chosen for this purpose: the General 
Aptitude Test Battery (GATB). the Differential 
Aptitude Tests (DAT), and the Tests of Adult 
Basic Education (TABE). 

Method 



Participants 

The MESA. GATB. TABK. and the DAT were 
administered to 64 participants as part of a 
comprehensive vocational evaluation at a non- 
profit rehnbilitatlon facility during 1986 and 
1987. The 54 men and 13 women participating in 
the study ranged in age from 17 to 52 years (M « 
27.3. SI) 9.0) with educational levels ranging 
from oight to Ifi years of school (M « 11.7. SD « 
1.7). All participants were receiving 
rehabilitation services from state funded 
agencies and disability diagnoses for the 
participants included: Developmental 
disability (n « 4. 6. OX), learning disability (n 
- 11, 16.4%), mental illness (n - 21, 31. 3;^;). 
multiple disabilities (n - 4, 6.05^), orthopedic 
dimibilily (n - 13, 19.4%). visual impairment (n 
« 1. 1.5%), and other (n - 13. 19.4%). 
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Instrumentation 

MESA. As summarized by Dotterbusch (i9R7), 
the MKSA system is comprised of multipln 
subtests. All subtests combined yield 84 items 
or inCormation which are designed to assess 
client characteristics related to vocational 
potential, with an emphasis on those identified 
in Worker Qualifications Profiles (WQPs) defined 
by the United States Department of Labor. Ambng 
the characteristics for whicli scores are derived 
are aptitudes, academic achievement, physical 
capacities, vocational interests, and vocational 
aiiaronetts. The foci of t.iis study are the MESA 
aptitude and academic achievement scores. 

Aptitude scores include the 11 WQP 
aptitudes in the following areas: Intelligence 
or General Learning (G), Verbal (V), Numerical 
(N), Spatial (S), Form Perception (P), Clerical 
Perception (0), Motor Coordination (K), Finger 
Dexterity (F), Manual Dexterity (M), Eye-Hand- 
loot Coordination (E), and Color Discrimination 
(C). The first nine aptitudes assessed by the 
MESA system are also assessed by the General 
Aptitude Test Battery (GATD; United States 
Department of Labor, 1970). Aptitude scores on 
the MESA correspond to the l-to-5 WQP aptitude 
levels, ranging from the highest to lowest 
standing relative to the general population. 
However, since the MESA is not designed to 
assess the very highest and lowest aptitude 
levels, scores of "1'* are collapsed with "2" and 
"5" with "4", The remaining scores of "2", "3". 
and "4" then indicate aptitude levels in the 
highest, middle^ and lowest one-third of the 
po'tjulotion , respectively. 

Academic achievement scores produced by the 
MESA include reading, math, vocabulary, and 
spelling. Reading level is assessed by two 
methods, a short paragraph and verbal opposites 
exercises: the exercises are written at the 4th, 
6th. 8th, 12th, and 14th grade levels. Math, 
vocabulary, and spelling problems are presented 
in order of ascending difficulty and scores are 
reported in criterion-referenced grade levels 
ranging from the fourth to the tenth grade+ 
level (Valpar International, 1984). Hence, 
scores are compared to the content domain taught 
at each grade level, rather than comparing 
scores to individuals enrolled in a particular 
grade (e.g., a 5.9 grade level math score 
indicates that the person can successfully 
complete math items that are typically taught in 
the 5th grade during the 9th month). 

As an adjunct to the academic achievement 
scores, the MESA produces General Educational 
Development (OED) scores on reasoning, math, and 
language. According to Valpar, 

OED embraces those aspects of education 
(formal and informal) which contribute to 
the worker's (a) reasoning development and 
ability to follow instructions: nnd (b) 
acqulsUlon of 'tool' knowledge such as 
language and mathematical skills. This Is 



educatioi cf a general nature which does 
not have a recognised, fairly Hpccific 
occupational objective, Ordinnriiy. kucIi 
education is obtained in clcmnntary school, 
high school, or college. However, it 
dorivos alsn from experience and soil-study 
(p. 106: MESA Statistical Information 
Report , undated) . 

MESA GED scores arc reported from one 
(lowest development) through six (highest 
development) . 

GATB . The GATE, a multiple aptitude test 
battery (United States Department of Labor, 
1970), was developed by the United States 
Employment Service more than 40 years ago 
(Dvorack, 1947). Droege (1983), among others, 
refers to the GATU as the best validated 
aptitude test battery ever developed. Twelve 
subtests are used to derive nine aptitude scores 
-G, V, N, S, P, Q, K, F, and M— the first nine 
WQP aptitude patterns. GATB scores are reported 
as standard scores with a mean of 100 and 
standard deviation of 20. For the purposes of 
the present study, GATB aptitude scores were 
transformed to the 2-to~4 scale used 
for MESA aptitude scores, where '2" - 109 or 
higher, "3" « 92-108, and "4" « 75-91. 
corresponding to the highest, middle, and lowest 
one-thirds of the general population, 
respectively. 

DAT . The DAT was revised in 1980 and 
consists of a battery of eight tests yielding 
nine scores: Verbal Reasoning, Numerical 
Ability, Verbal Reasoning-Numerical Ability, 
Abstract Reasoning, Clerical Speed and Accuracy, 
Mechanical Reasoning. Space Relations, Spelling, 
and Language Usage. The Verbal Reasoning- 
Numerical Ability score is actually the sum of 
raw scores on the Verbal f^easoning ard Numerical 
Ability tests and is considered to be an index 
of scholastic aptitude (Bennett, Seashore. & 
Wesman, 19B2). Scores are reported in both 
percentiles and stanlnes on each of the eight 
tests and are given separately for sex and grade 
level . 

According to itj developers, "The tests arc 
designed to appraise fundamental intellectual 
abilities and to avoid as much as possible 
dependence on the learning of particular school 
subjects.... The aptitudes or abilities 
measured by the DAT are important in a great 
many educntionai and vocational situations'* 
(Bennett et al., 1982; p. 7). Strong evidence 
supporting the DAT's reliability and validity 
have been reported. In fact Anastasi (1988) 
reports that 

The amount of validity data on the DAT is 
overwhelming, including several thousand 
validity coefficients. Most of the* dala 

are concerned with predictive validity 

(and) many of the coefficients are high, 
even r^nh intervals as long as three years 
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between tost and criterion dam The 

Verbal Reason tng- Numerical Ability teat, 
correlates in the .708 and .aos with 
composite criteria of academic achievement 
(p. 39^), 

lABli' The TABE is an achievement test 
producing scores in roadinR, mathematics, and 
language and was adapted from the California 
Achievement Tests (CAT), 1970 Edition 
(CTB/McGraw-Hiil, 1976). The TABE is intended 
to measure basic skills required of an 
individual to function in our society and is 
appropriate for use with adults of limited 
education and from various cultr.ral 
backgrounds . 

The three levels of the TABE, E, M, and D, 
reflect level of difficulty: easy, medium, and 
difficult respectively. Level D, used 
exclusively for this study, subdivides rending 
into three scores: Vocabulary, Comprehension, 
and Total Reading: mathematics consists of three 
scores: Computation. Concepts & Problems, and 
Total Mathematics: and language consists of four 
scores: Mechanics. Expression, Mechanics a 
Expression Total, and Spelling. For the present 
study, separate scores on Mechanics and 
Expression were omitted in favor of the combined 
Mechanics & Expression Total score. Scores on 
all subtests are reported in norm-referenced 
grade equivalents ranging from 5.0 to 12.9. 

Reliability analyses of the TABE found te;jt- 
retest and Kuder-Hichardsun coefficients to be 
primarily in the .808 and .90s. A validity 
study performed on the TABE. level D, reported a 
correlation between it and Tests of General 
Educational Development (GCD Tests) of .56, 
which according to the test developers, 
"...indicated a substantial relationship between 
TrtBE and OED scores" (p. 9). Further, because 
of its relationship with the CAT. the TARE 
developers refer to the extensive validity data 
supporting the CAT found in the CAT Technical 
Report (1970). 

Results 

As an estimate of the MESA's construct 
validity, Pearson product-moment correlation 
coefficients were calculated between MESA 
aptitude scores and corresponding aptitude 
scares on the CATB and the DAT. and between MESA 
academic achievement scores (including GEO 
scores) and corresponding academic scores -^n the 
OAT and TABii. The following sections detail 
these analyses. 

Aptitud e Scorea \ 

Table 1 presnnt.s correlations brMween tho 
MESA nnd GATR aptitude scores (oorresponriinir 
aptitude scores have been underlined and are 
found along the diagonal of the matrix). 
Correlations ranged from . Ofi (CJerical) to .52 
(Verbal). Significant correlations were found 
between six of thr nine correspondinK aptitude 



scores: General Learning (G, r » .42). Verbal 
(V, r - .52). Spat. Hi (S, r = .4<i), Motor (K. r 
= .33), Finger Dexteiity (F, r » .37), and 
Manual Dexterity (M. r " .40). With the 
exception of Motor (M) the above correlations 
were at the .01 level of significance. Non 
significant correlations for corresponding 
aptitudes were found for Numerical (N), Form 
Perception (p), and Clerica.l (Q) scores. 

Table 2 presents correlations between the 
M!iSA and DAT aptitude scores. Significant 
correlations between corresponding aptitudes 
were found between MESA G and DAT Verbal 
Reasoning & Numerical Ability (r « .53. p < .01) 
and MESA V and DAT Verbal Reasoning (r ^ .A9, 
p < .01) and DAT Language Usage (r « .38, p < 
.05). Non-significant correlations between 
corresponding aptitudes were found between MESA 
N and DAT Numerical Ability; MESA S and DAT 
Space Relations; and MESA Q and DAT Clerical 
Speed and Accuracy. 

Academic Achievement Scores 

Table 3 presents the correlations between 
MESA academic achievement and GED scores with 
DAT scores. Regarding corresponding academic 
achievement scores, significant correlations 
were found between MESA* Math and DAT Numerical 
Ability (r - .37, p < .05); MESA Vocabulary and 
DAT Verbal Reasoning (r - .57. p < ..01) and DAT 
Language Usage (r - ,35. p < .05); MESA Spelling 
and DAT Spelling (r « .67, p < .Oj); and MESA 
Reading aad DAT Verbal Reasoning (r - .71, p < 
.01) and DAT Language Usage (r « .43, p < .01). 
MESA GED scores were significantly correlated 
with the corresponding DAT scores on MESA 
Reasoning and DAT Abstract Reasoning (r « .56. p 
< .01): MESA Math nnd DAT Numerical Ability (r ^ 
.31, p < .05): and MESA Language and DAT Verbal 
Reasoning (r - .59. p < .01) and DAT Language 
Usage (r « .35. p < .05) . 

Table 4 presents the correlations between 
MESA academic achievement and OED scores with 
scores on the TABK. Regarding corresponding 
academic achievement scores, significant 
correlations were found between MESA Vocabtlary 
and TABE Vocabulary (r - .59), Comprehension (r 
« .47), and Reading Total (r « .58). and 
Language (r « .45), all of which were at the 
.01 level of significance. MESA Spelling was 
significantly correlated with TABE Spelling (r = 
.09, p < .01): MFSA Reading wa| significantly 
correlated with TABE Vocabulary (r « .45), 
Comprehension (r .53). and Reading Total (r - 
.54). and Language (r - .53): all correlations 
were at the .01 level of significance;. MESA GED 
scores were signif ir^nntly correlated between 
MESA math and TABE Computation (r - .32J, 
Concepts and Problems (r - 31), and Math Total 
(r - 3J), all of which were at the .05 level oi 
significance. MESA Language produced 
significant correlates with TAHE Vocabulary (r ^ 
.34, p < Ob). Comprehension (r ■ .41, p < .01). 
Reading Total (r - . 41 . p < .ni ) . and Language 
(r " .53. p < .01). The only non-significant 
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correlations between corresponding MESA and TAhE 
scores involved the MESA aoadfifnic achievement 
muth score. 

Discussion 

Despite the small number of ptirticipants 
u.;ed in the present study, o number of 
siunlficant correlations, most at the .01 level 
of significance, were found between the MESA and 
other tests which purportedly measure the sane 
constructs. Most of the significant 
correlations were moderate (in the ,408 and 
.50a); according to Anaataai (1988), 
correlations between tests "should be noderately 
high, but not too high. If the new test 
correlates too highly with an already available 
test, without such added advantages of brevity 
or ease of administration, then the new test 
represents needless duplication" (p. 154), In 
terms of aptitude scores, the MBSA G and V 
scores were found to be correlated with 
corresponding scores on both the GATD and DAT, 
while correlations between N and S scores were 
less consistent. MESA aptitude scores P and Q 
failed to produce significant correlations with 
corresponding GATB scores indicating that they 
may be less valid measures of these aptitudes. 
These results are somewhat inconsistent with 
similar research conducted by one of the present 
authors. Janikowski (1989, March) found that 
only three of the nine MF.SA aptitude scores (V, 
S, and P) correlated significantly with 
corresponding GATB aptitudes; however, this 
study employed a different population (non- 
disabled, displaced workers) and a smaller 
sample size. Nonetheless, this discrepancy 
suggests a need for additional research on the 
validity of the MESA aptitude score' for 
differing client populations. 

The MESA academic achievement and GEO 
scores produced a number of significant 
correlations with corresponding scores on the 
DAT and TABE. All of the corresponding 
achievement and GED scores between the MESA and 
DAT wore significantly correlated with six out 
of the ten being significant at the .01 level. 
When compared to the TABE, the MESA correlated 
significantly with all corresponding subtests 
except for the academic achievement math score. 
In comparison to MESA achievement, MESA aptitude 
scores tended to demonstrate weaker correlations 
with other measures. One reason for this 
difference may be the restricted range (2 - 4) 
used for the aptitude scores. 

In sum, moderately strong evidence was 
found supporting the cimstruct validity of most 
the MESA aptitude and achievement scores. MESA 
numerical and math scores, alnnj* with form 
perception and clerical aptitude scores, 
however, appear to present some problems. The 
MESA N score was not significantly corre luted 
with either the GATB N or DAT Numerical Ability 
score. The MESA academic achievement math score- 
was not related to correnpond i nr, scores and 



the MESA GED math tended to produce smaller 
coefficients with both the DAT and TABE. These 
findings indicate that MESA numerical and math 
scores may be less adequate measures. Sinc(; 
both the numerical and math scores are derived 
using the same exercise (Valpar International, 
1985), there may be problems with the MESA's 
mathematics item base that warrant investigation 
its developers. In addition, the MESA N, P, and 
Q scores wers not significantly correlated with 
GATB N, P, and Q scores, indicating that the 
items used to derive these scores are not 
measuring the same constructs. Continued 
research into the MESA system's validity seems 
tieccssary and will, hopefully, result in 
specific refinements of this popular evaluation 
system. 
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